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ABSTRACT 

With expiration of the Comprehensive Employment and 
Training Act (CETA) impending, the United States General Accounting 
Office (GAO) reviewed four types of adult-oriented service: classroom, 
training, on-the-job training, work experience, and public service 
employment. The GAO researched and synthesized program administrative 
data and the results of evaluation and research studies, and analyzed 
employment statistics to determine who enrolled in the programs, what 
types of services and wfyat benefits were provided .them, what were the 
employment experiences of the enrollees both before and after 
participating in CETA, and how effective the services were. GAO found 
the following four outcomes, among others: (1) CETA adult-or tented 
services were well targeted — the enrollees were generally 
disadvantaged economically and educationally, which affected their 
eni^6yment stability; (2) outcomes differed for the four services, 
but these differences were expected since occupational areas and 
characteristics of participants also varied; (3) on the average, 
early participants were better off after CETA than before in terms of 
increased employment and earnings and reduced ^reliance on public 
benefits; and (4{) because of limited data, CETA's effectiveness can * 
be addressed only in terms of earnings. No more than a small 
proportion, of the . improvement in earnings can be attributed directly 
to CETA, but women and individuals appear to have profited more than 
other groups as a result of the program. (KC\ 
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CETA Programs For Disadvantaged Adults- 
What Do We Know About Their Enrollees, 
Services, And Effectiveness? 

With expiration of the Compr^ensive Employ ment and 
Training Act impending and Cinemployment persisting, 
GAO reviewed four types of adult-oriented service: 
classroom training, on-the-job training, work experi- 
ence, and public service employment. GAO found that 

-CETA adult-oriented services were well targeted. 
The enrollees were generally disadvantaged eco- 
nomically, educationally, and witfrregard to employ- 
ment stability. 

-outcomes differed for the four services, but these 
differences were expected since occupational areas * 
and characteristics of participants also varied. . - 

-on the average, early participants were better off y 
after CETA' than before in terms of increased/^ 
employment and earninggand reduced reliance on 
pub(ic benefits. 

-because of limited data, CETA's effectiveness can 
be addressed only in terms of earnings. No more 
than a small proportion of the improvement in 
earnings can be attributed directly to CETA, but ' 
women and people with extremely poor earnings . 
histories appear to have profited more then other 
* groups as a result of the program. 
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UNITED STATES GENERAL ACCOUNTING OFFICE 
WASHINGTON; D.C. 20548 



B-206174 



The Honorable Augustus F. Hawkins 
Chairman, Subcommittee on 

Employment Opportunities / 
Committee on Education and Labor ' " 
House of Representatives 

Dear Mr. Chairman: 

This report summarizes the results of our review of 
services for disadvantaged adults under the Comprehensive 
Employment and Training Act. As you requested, we con- 
ducted an assessment of program administrative data and 
the results of federally funded and independent evaluation 
studies on four types of service — classroom training, 



on-the-job training^ 
employment 



work experience, and public service 



Integrating what we judge to be the soundest and most 
comprehensive information available, the report summarizes/ 
what is known about enrollees, services, and outcomes; it 
also identifies major gaps in our knowledge about these 
program3. At your request, much of the information con- 
tained in this report was previously communicated during 
a joint briefing of >interested House and Senate staff on 
October 13, 1981. 

We sought comments on the report from the Department 
of Labor and DOL ' s response is reproduced 'in appendix IV. 

. Sin6erely yours, 



Eleanor Chelimsky 
Director 
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DIGEST 



CETA was designed to establish comprehensive 
and decentralized employment and training 
services throughout the Nation* How well has 
dETA performed?' With CETA's expiration impend- 
ing, the problems of structural and cyclical 
unemployment persisting, and new .proposals 
being considered, it is essential to examine 
CETA's per formanc^ and to understand the con- 
text in which its services are delivered. 

In this report, undertaken at the request of th<=* 
House Subcommittee on Employment Opportunities, 
GAO examines the performance of adult-oriented 
CETA programs with regard to enrollees, services, 
and effectiveness by focusing on the following 
five questions: 

1. Who were the enrollees? 

2. What types of service and what benefits 
wer?* provided them? 

3. Who were the recipients of the varfbus 
types of service? / 

4. What were the employment experiences of 
the enrollees/ both before and after 
participating in CETA? 

5. How "effective were the services? 

To answer these questions, GAO looked at CETA's 
Comprehensive Services and Public Service 
Employment (PSE) programs, focusing on four- 
types of CETA adult service^-classro f om train- 
ing, on-the-job training, work experience, and 
public service employment. 
. * 

GAO reviewed and synthesized program adminis- 
trative data and the results of evaluation and 
research studies and analyzed employment sta- 
tistics, to answer the five questions and to 
identify important gaps in existing informa- 
tion on CETA adult-oriented services- Unfor- 
tunately, the most comprehensive information, 
was also the least current- l ' 
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In general, GAO found that tffrA/s adult-oriented 
services were well targeted toward disadvantaged 
individuals- The outcomW of the four services 
differed, but this was not surprising since the 
services also varied in terms of the levels of 
disadvantage of the participants and the occu- 
pational areas of employment opportunities or 
training . 

Because the data are limited, CETA's effective- 
ness can be addressed only> in terms of earnings. 
On the average, early CETA participants were 
better off after the program than before with 
regard to increased employment and earnings and 
reduced reliance on public benefits. Although 
in the, aggregate only a small proportion of this 
improvement in earnings can be directly attrib- 
uted to CETA, women and people with extremely 
poor earnings histories appear to have profited 
more than other groups as a result of the 
program. 

WHO WERE THE ENROLLEES? 



Significant proportions of enrollees in tie 
Comprehensive Services and PSE programs were 
disadvantaged economically and educationally, 
and they had little past employment stability. 
For example, approximately one-third of the 
enrollees in the major adult services in fiscal 
1576-78 were unemployed at least 50 percent of 
the year preceding their enrollment- Another 
one-fourth to one-third were out of the labor 
force at least 50 percent of that year, 
(pp. 38-41) ( 

WHAT TYPES OF SERVICE AND WHAT BENEFITS 
WERE PROVIDED THEM? T ~ 

The mix of services in the Comprehensive^ Serv- 
ices title shifted away from work experience 
'toward classroom training between 1975 and 1980. 
(pp. 41-43) As programs unc^er the PSE titles 
grew, however, the overall adult service mix 
fcTr CETA increasingly emphasized various forms 
of subsidized work opportunity. 

Oecupational areas of employment and training 
services varied among tjie service types. 
During fiscal 1976/ the employment opportunities 
provided tp enrollees in PSE and work experi- 
ence programs were likely to be in clerical, 
service, or laborer ocQlipation£ • Classroom and 
on-the-job training services pu<t more emphasis 
' 1 v 



on craft and operative occupations, areas -that 
typically pay higher wages. (pp. 43-46) 

i 

On the average, .early participants realized 
substantial* gains in earnings while they were 
enrolled in CETA, and more than 40 percent 
received ancillary employment or supportive 
services • (pp. 49-51) 

For fiscal 1975-80/ job 'placement rates re- 
ported by prime sponsors to the Department of . 
Labor fc?r the Comprehensive Services title 
ranged from 28 to 45 percent and from 31 to 42 
percent for the PSE titles. Rates by service' 
type reported -in the Continuous Longitudinal 4 
Manpower Survey for fiscal 1976 participants 
were higher', the percentages being 39 for class- 
room training, 55 for work experience, 67 for 
public service .'employment, and 69 for on-the-job 
training. Thus 'the prime sponsor repprts appar- 
ently underestimated the number of people who 
obtained jobs immediately after leaving CETA. 
(pp. 51-55) , 

WHO WERE* THE RECIPIENTS OF THE VARIOUS 
TYPES X 0F SERVICE? 

In fiscal 1976, participants in classroom 
training and worx experience were more dis- - 
advantaged than participants in on-the-job 
training and PSE in terms of individual and 
household income, employment stability, ajid 
receipt of public benefits. This pattern' per*- 
sisted in 1978, except that PSE participants 
had become more disadvantaged. (pp. 46-49) 

WHAT WERE THE EMPLOYMENT EXPEDIENCES 
OF THE ENROLLEES BEFORE AND. AFTER 
PARTICIPATING IN CETA? 

Information on participants' experiences 
before and after CETA is 'CQnfined to people 
\ enrol led between, January- 1975 and June 1976.- 
Reviewing this, GAO found the following: 

— Earnings and employment declined in a con- 
sistent pattern for participants in the year 
preceding their enrollment. On average, 
however), they attained earnings and employment 
levels immediately after leaving the program 
that were equal to an8 sometimes exceeded the 
high. point of their pre-CETA* year . They 
continued to show further improvement 'over 
the next two years • (pp. 60-66) • 



— The proportion of -participants whose house- 
holds received* public benefits decreased from' 
38 percent in the *year before CETA to 25 per- 
cent two years after CETA. (pp. 66-67) 

— After leaving CETA, participants were more 

lively to be in public sector jobs than be- 
v fore CETA. Among January-June 1975 partic- x 
•ipants employed one year before entering CETA, 
82 percent had held private sector jobs. Only 
66 percent of those employed two; years after* 
GETA held private sector jobs. (pp. 67-6 9") 

>fiAO also foand that differences across service 
Wpes in the characteristics of participants and 

their occupational areas of employment and 
training are reflected in the data on their ex- - 
periences before and after CETA. In particular, 
GAO found the following: 

— Classroom training and w<*rk experience par- 
ticipants (who were generally more disadvan- 
taged than participants in on-the-job training 
and PSE at the time of enrollment) had poorer 
earnings and employment circumstances than 
on-the-job training and PSE participants, both 
before and after CETA.' (pp. 69-75) 

— Employed t^rminees from classroom training 
and on-tfie-job training in January-June 1975 
were much more likely to have found employ- 
ment In the private sector two years* after 
CETA (at 84 and 83 percent) than employed 
terminees from work experience and PSE (at 
65 and 52 percent), /(p. 76) 

HOW EFFECTIVE WERE THE SERVICES? ' > 

The single effectiveness study available ^ 
estimates that ohly $300-$400 of *1977 post- 
program earnings can be attributed directly 
to ££TA participation in adult-oriented serv- 
ices during fiscal 1976. By service type,' 
this* study estimates gains of $850 for on-the- * 
job training, $350 for classroom training, and 
$250-$750 for PSE and no significant gains for 
work experience. (pp* 82-84) 

White and minority women had significant net 
gains of §500r-$600, as did participants with 
the poorest earnings histories. (pp. 84-86) 
Distributions of gross earnings changes over 
the period 1974-77 suggest /that even though 
the aggregate net gain was (small, some women 
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and poor earners had fairly substantial net 
gains from CETA. (pp. 86-90) 

THE PRIVATE SECTOR INITIATIVE PROGRAM 
AND MACRpECONOMIC ISSUES 

GAO's assessment of CETA's Private Sector Ini- 
tiative Program is necessarily limited because 
the program^ is young. Its overall job placement 
rates and rates of private sector employment are 
slightly higher than for the Comprehensive Serv- 
ices title. However, these differences can be 
explained by its smaller size, greater emphasis 
on on-the-job and classroom training, fewer in- 
s-dhool services, and less-disadvantaged enrollees. 
(pp. 92-97) * 

gVo outlines the major macroeconomic issues asso- 
ciated with the provision of Federal funds for em- 
ployment and training seryices and reviews studies, 
that estimate the extent of substitution of Federal 
funds for State and local funds. (pp. 98-110) 

. OBSERVATIONS 

CETA has had the dual objective of addressing 
both structural unemployment (ajnisfit between 
the skills employers need and tfie •skills job- 
seekers have) and cyclical unemployment (stem- 
ming from a decrease in aggregate demand in 
the ( economy This complexity, along with 
fluctuations in CETA's emphasis and its attempt 
toJ?oster flexibility in matching local employ- 
*mtot and training resources with the adverse 
nJfeds 'of the unemployed,, has made assessment 
of ) its performance 'especially difficult. 

On the one hand, GAO's review indicates that 

CfiTA's adult-oriented' services were well tar- 
geted toward the disadvantaged unemployed; 

on average, the employment and earnings cir- 
cumstances of early participants were better • 
after CETA than before, and their reliance 

„ on various forms of public benefits also de- 
creased. While this kind of pre-post infor- 
mation cannot be used directly to infer pro- 
gram effectiveness, the fact that a relapse 
did not occur over a 'two-year period after 
CETA is encouraging; 

/ 

— although in thk aggregate only a small 
proportion of the earnings improvement 



v 3 



after CETA can be directly attributed to 
the program, some 1 , improvement was evident, 
and for 'women and the most economically 
disadvantaged participants the net improve- 
ments were greater. * 

On the other hand, 

— t] ? e3 f e is evidence ' at 'least far early par- 
ticipants, that employed terminees from work 
experience and PSE, compared to other serv- 
ices, tended to be disproportionately in 
public sector rather than private sector 
jobs, where most new jobs are created. This 
finding indicates £hat links between busi- 
ness, industry, and CETA should be stronger. 

— despite the fact that more people probably 
move into jobs when leaving CETA than prime 
sponsors report, there is little reason to 
believe that obtaining a job immediately 
after CETA indicates a long-term improve- 
ment in earnings capacity. 

On-the-job training appears at first more 
successful than other Services in postprogram 
outcomes, but this may be explained at least 
partly by its less-disadvantaged enrollees. 
Work experience, often criticized for poor 
outcomes, has been given to some of CETA's 
most disadvantaged enrollees (those with his- 
tories of weak labor ,,force attachment) and, 
therefore, it is not surprising that, work 
experience has had poorer out com£fe. 



DOL's Continuous Longitudinal Manpower Survey is 
a rich data base; without it we would know much 
less about CETA. The one earnings * impact study 
that is available is based on CLMS data, and 
CLMS could be used to explore other possible 
benefits of CETA for participants and society. , 
Nevertheless, GAO's review was hampered by the 
-fact that the soundest and most comprehensive 
information is the least current. Further, the 
widely used performance indicator of job place- 
ment rates is 'deficient in its usefulness as a 
measure of program effectiveness. And informa- 
tion is lacking on the degree to which local 
resources may constrain program performance. 

GAO requested, comments 'from" the U.S. Department 
of Labor but DOL declined to make specific com- 
ments because the report contains no recommenda- 
tions, (pp. 134-35) 
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Proposed economic and noneconomjLc benefits 
from employment and training programs* \ 

Summary of studies relating placement 
to earningjp gains , 

Sources of selection bias in evaluations 
of employment anci training programs 

Estimates of the degree of substitution 
and displacement associated with'PSE 
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ABBREVIATIONS 

Aid toFamiiies with. Dependent Children. 

Ancillary ^services 

Bureau of Labor Statistics 

Comprehensive Employment and Training Act 



1 7 



\ (Abbreviations continued) 



CLMS „ Continuous Longitudinal Manpower Survey 

CP/PV Corporation for Public/Private Ventures 

& cjy S Current Population Survey " /* 

CT Classroom training 

DOL * U.S. Department of Labor 

GA0 U.S. General Accounting Office ' 

# LLSIL BLS^Lower Living Standard Income Level 

OJT - On-the-job training - * 

0 MB Office of Management and Budget 

PEP Public Employment Program 

P SE - Public Service Employment 

PSIP Private Sector- Initiative Prograni . 

Pub.- L. No. Public law number » » 

ss * v , Supplemental Security Income- 

TQ Transition quarter , * 

WE ' > Work experience 
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* CHAPTE R 1 
INTRODUCTION 

The Federal Government spent more than $14 billion for 
employment and training activities in fiscal year 1979, a sub- 
stantial increase over the $250 million it committed to this area 
in fiscal year 1961. Over the past two decades, it has tried to 
ease bdth structural unemployment , resulting from a- chronic mis- 
match between -fche skills that job seekers "have and the skills 
that employers seek, and cyclical unemployment, resulting from . 
a decrease in aggregate demand for the economy as a whole. The 
basic types of program service—classroom and on-the-job train- 
ing, subsidized work opportunities, and counseling and referral- 
remained fairly standard in those 20 years, but the mix of serv- 
ices changed as emphasis shifted between counteretructural and 
countercyclical objectives 

^For more than the^ first half of the period, or before 1974, 
the Federal Government admini stered most employment and training- 
programs directly, through some 10,000 contracts with the U.S. 
Department of Labor, but this to» 0> changed dramatically. V/ith the 
passage 'of Public Law 93-203, the Comprehensive Employment and • 
Training Act of 1973, or CETA, control over employment and train- 
ing services shifted to State , and local governments. Many pro- 
grams were decentralized and decategori zed because decisions on 
whom to serve and what services to provide ; were believed better 
made at State .and local levels. ' 

About $9. .4 billion of 'the $14 billion 'spent for employment 
ana- training programs, in "fiscal year 197^ was -for services 1 de- 
livered under CETA., The' financial commitment to these programs 
, decreased after 1979 and s,dme activities, such as public service 
employment, have been terminated. Questions have been raised 
about the merits of these programs and their effectiveness and 
whether and how they should be improved. .CETA s 1982 reauthor- 
ization date is approaching, and so it is especially important 
to know how the programs are functioning and how effective the 
various types of service are . 

OBJECTIVES, SCOPE, 
AND METHODOLOGY 



( 



He 
on 



W.e undertook our review in response 4^> a request from the 
Honorable Augustus Hawkins, Chairman of the Subcommittee on Em- 
ployment opportunities of the U.S. House of. Representatives. H 
asked us to assess and integrate existing evaluation informatio 
on four types of CETA servic es— classroom training, on-the-joo 
training, work experience, and public service employment. Accord 
ingly, we focused our review on adult-oriented services delivered 
through CETA, specifically on title IIB, the major Comprehensive 
Services title, and titles IID and VI, the Public Service 
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Areas Covered I by the R. VI . W of the Comprehensive Services 
and Public Service employment Titles 

Within CETA experiences 



Comprehensive Services (MB) 



Classroom Training 



On the Job Training 
C 



Wa^< Experience*^ 
■ i^u. 



Other 




public Service Employment (MO -VI) 



Public Service Employment 
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-seTatpfe infection, 
soundest and most comprehensive inX™^ W6 DUdged t0 be the 
ices, to summarize whit we know IZJ^ ™" ° n . CETA adUlt serv ~ 
and effectiveness, and tWaSe ^intT^ im P leme "tation 
we do not know. to jraisej^rtinent questions about whal 



Throughout our review, we tried to answe'r five questions: 



3 

4. 

5. 



Who were the enrol Lees? 

+$h2S" ° f SerV1 ^ and " hat »—«t. were provide* \ 
Zlfxll* ^ IeCl P le »« «" .^e various types of 

How effective w % re the services? C * TA ? / 

3./We use the terms "adult services" an* "^..u 

to refer to services for adnt?f S 2 adult -°riented services" 

school, we use the te?ms "cllL I f ° r Y ° Uth who are not 

title ire andVPublic Sergio! S rel ? ensive Services" to refer to 

Mtles IID and S of the Act ^Sn^w" ° r ,,pSE " to refe ^ to 
fading and ^ainin^f*^ 
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periences of CETA participants one year before their entrance to- 
CETA , their characteristics at the time they enrol led , the mix of 
services and within-progran benefits they received, their satis- 
faction with CETA, their status at the time they terminated from 
CETA, and their experiences after CETA for up to 24 months . We 
also, asked tha same five questions about a recent addition to 
CETA, title VII, the Private Sector Initiative Program,, but in- 
formation is limited and our summary of this program is- brief. 
Finally, some of our questions led us to review existing, research 
on the extent of substitution and displacement associates with, 
PSE and some of the other macroecohomic issues associated with 
employment and training programs. Host of the information in 
this report was communicated to House and Senate staff during a* 
joint briefing in October 1981. £ 

We were halped in identi f y ing -many of our information 
sources by the *»S. Department of Labor (DOL) , in particular by 
the Office of Program Evaluation and the Office of Research and 
Demonstration in the Employment and Trailing Administration and 
by the office 4 of the Assistant Secre.tar-/ for Policy, Evaluation, ^ 
and Research. Among the literature and data we used were DOL 
participant characteristics, program status, and financial sum- 
mary reports and DOL evaluation studies . We analyzed reports of 
the National Commission for Employment Policy, the National Counr^. 
cil on Employment Policy, and independent eyaluators and academic 
researchers. We relied heavily on data from the .Continuous Lon- 
gitudinal Manpower Survey, a survey that tracks ^Participants 
after thay terminate from the program, and analyses of the survey 
data conducted by. Westat, Inc., some of which wer«e performed for 
the present review. The reference list in appendix II serves both 
as a selected bibliography, somewhat narrower than the full scope 
of.our information sources, and a citation list for material we 
quote apd discuss in the report. 

The criteria we used in deciding which reports and data 
sources to analyze and summarize included questions about the 
>rigor o€ the study design, the adequacy of the sampling strategy, 
the relevance and quality of the data, the appropriateness of 
statistical analyses, how well the results could be generalized, 
and comprehensiveness. This. means that we excluded ,. for example, 



/ 



data because of aggregation procedures the ».§.. Department of 
•Labor uses for the prime- sponsor reporting system. Since I IC 
is a relatively small component of the total distortion is » 
minimal. Additionally, our information on IIB does not give 
us a pure picture of CETA adult services because in-school 
work experience services are not separable from services for 
out-of-school youth and adultsV Information on titles IID 
and VI is presented separately at some times and combined at 
others because of constraints imposed by the form of the 
available d^ta and because of the undifferentiated nature of 
the PSE titles during CETA' s later years. ^ 



toTTo!!? 1 ° cal . e ^ aluation reports that had be'en designed largely 

otherwise Ivatlltll ^ P ur P° ses ° r that duplicated information 
otnerwise available at the national level. Except for fisral 

FeVieTK?^^ 1 ? ??° 1Uded data °" Pr °9ran, c£ts fro"our 
review. We included all major national evaluations of CETA »d,,lt 

the V ii™L»?-° Ur r r ieW - Where »PP^i"e. we nave poised out 

rant^n^ ?i f „^„^?° UrCeS deg " e ° f ««" 

able ^ t rhf°" ght informat ion sources, the limitations of avail- 
Sn„ f ■ r apparent. For instance, data S*ere available 
wJln ?J Cal year 1980 r fbr the characteristics of participants 
when they entered CETA, /the mix of services they received and 

^efore St durin: hen ^J^' ^ data oT^ri.SSe. 

before, during, and after CETA were available only for early 

' ?q76 1C1 f a v ' th ° Se Wh ° enrolled between January 1975 and June 
1976. Likewise, estimates of CETA ' s^f feet on participants' 
earnings after they left CIJTA were available only for fiscal year 
1976 participants. 1/ Moreover, changes in the PSE titles and 

natureTf PSE ftS ^ ^characterises of participant Xd £L 
nature of PSE services hamper the usefulness of early data for* 

clalsroom Inll/t^ £ e f formance ' * though the information on 
classroom and on-the- 3 ob training as well as on work experience 
is. less vulnerable in this way. experience 

and Jn^f rstand the types of employment and training services 
start wfS \ S P r ° Vlded ?° CETA P art icipants, it is necessary to 
lill I ! he ori 9\ na l Program in 1973 and track changes in its 
size, structure, and^ method of operation up to the present in 

,labor 10n 'v C f A T". 136 PlaC6d in Contex t with respect tS n^ional 
( J»nn t co " 6ltlons and local political and fiscal circum- 

croSnd%or ^ ingly '- We ^ thiSYin ^ter 2, setting the back- 

ground for our discussion of evaluation issues. In chapter 3 we 

' t?ainJno a Jo riety of /Y aluat ion criteria for employment^ ' 
the fouM^ll "I dlSC " SS th6ir a PPropriateness for assessing 

the four types of service. We also outline ■ the strengths and 
weaknesses of various, evaluation strategies. ' - 

and pse ? a H^ r ? k ; n ou t. our . analysis- of the Comprehensive Services 
and PSE titles information in the following way. We describe 

r .- mple ^ entati ° n as P ect s, presenting information on the 
•characteristics of participants, the mix of services, and the 

?he U fnfo5 m ,% erV1CeS in = ha Pter 4. Following this/ we summarize 
flLl ;2 rmatl ? n on withm-program- experiences and benefits in 

/ arningS 1 l ancillar y services, and satisfaction. We also 

L r it s ;d nt f d :r C E?A? he status of ^ ^ t h ey 



1 IftI\ t{, ma l^ ar t- f ° r 1977 e*™™^- Additional analyses of 
• CETA s effect on this group's 1978 earnings, and the first set 
DOL il^lV 1977 - Participants, are due to be released by 



Then, in chapter 5, we summarize what ^ is known about ttie ( 
earnings and employment experiences of several groups of early 
participants \in CETA for 12 months before the program and up to 
24 months aft\r it* We include in this nummary information on 
earnings, percentage of time employed, percentage of participants 
employed at selected times, hourly wage rates, receipt of public 
benefits and Unemployment Insurance, ami location of employment 
in the private and public sectors- We are able to provide earn- 
ings information for subgroups by gender, race, education, and 
other characteristics* 

We summarize in chapter 6 tfie only nationally generalizable 
information on the effectiveness of CETA adult Services with ref- 
erence to net changes in earnings- It is based on comparisons 
of 1977^earnings covered by Social Security for the Continuous 
Longitudinal Manpower Survey sample of fiscal year 1976 CETA 
participants and match groups drawn from the Current Population . 
Survey- We present distributions of earnings changes for 1974-77 
, for these groups as well. * 

Our brief overview of, the Private Sector Initiative Program,, 
title VII, is in chapter 7„. It is confined for the most part to 
a description of the startup of PSIP, the characteristics of the 
participants, the types of service provided them, and the status 
of terminees at the time they left the. program. 

In~chapter 8, we identify some of the macroeconomic issues 
regarding employment and training programs and review studies on 
the extent of substitution and displacement associated with 
Public Service Employment programs. 

7 . 

We present a summary and interpretation of the major find- 
ings of the review in chapter 9. Vfe also point out gaps in our 
information on CETA adult services ,\and we suggest some ways of 
increasing our knowledge in the future . 

» » 
The request letter fjom Augustus F. Hawkins, Chairman of 
(v the Subcommittee on Employment Opportunities of the House Com- 
mittee on Education and. LaVor , is reproduced in appendix III. 
Vrt; requested comments on a\raft of this report from the U.S. 
Department of Labor; DOL's comments are__r_ej2j;oduced in appendix 
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CHAPTER 2 

r 

CETA'S CONTEXT— THE BACKGROUND 
FOR EVALUATION 



_ A general overview* of the Comprehensive Employment and 
Training Act fr^m -its inception in 1973 to the time we initiated 
our review shows that' 1 it changed in both structure and objec- 
tives, while the nature of the program widened to combat not • 
only unemployment caused by mismatches between employers 1 needs 
fn \iZ b K se ? kers * skills but a^o.unemploymern^Wsed by downturns 
m the business- cycle, its eligibility requirements narrowed, 

?§T^ro r S US "S" shar P lv on economically -disadvantaged. 

Tne program became^ increasingly complex and categorical in nature 

?ETA°fJ^ UPS 7 ith SP6Cial needs > re identified and targeted, 
n^f t - L an6 resour . ces ' noweve(r, were never of the same mag- ■ 
nitude as the unemployment problem. Additionally, sometimes it 

?E?A? 1/ t0 reconcile local and^national objectives for 

HOW THE STRUCTURE OF C ETA CHANGED 
BETWEEN 1973 AND 1978 J~ 

"and T^nin 11 r! ?n a K t6d 1973 ' the Co ™prehensi ve Employment'" 
and Training Act (Pub.-L. No. 93-203) was meant to respond to", ' 
criticisms that employment and training efforts were duplicative 
at the local. level and that national control over them needed a 

?Q7^ en, ^ asis « As P art °f the "new federalism" early in 
the 1970- s, the CETA legislation -was grounded in the belief that 
fiI?wJ? SO v rCe f f° r addre ssing unemployment are dominantly Fed- 
eral while knowledge of local needs for employment and traininq 1 
services resides with local authorities. Up to 1973, federally 
assisted employment and training programs had evolved independ- 
ently into a patchwork of activities and funding mechanisms: 

Bv the end of the 1960s there were more than 17 pro- 
grams, each with its own legislative and organizational 
&ase, funding source, and regulations. Out of these 
so-called categorical programs flowed 10,000 or more 
specific manpower projects, often several in the same 
community competing for the same clientele and resources. 
These programs generally were conducted through public 
and nonpublic agencies but not through the local govern- 
ments themselves. (Mirengoff and Rindler, 1976, p. 2), 
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1/Smce the time we initiated this review, the Public Service * 
x_ Employment titles, IID and VI, have been discontinued, as has 
the Young Adult Conservation Corps, title VIII. Realizing the 

' ?q?I ™^ S * Stlil in flux ' we have used the terminology of the 
,1978 CETA Amendments when referring to specific titles. 
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CETA was. to be an umbrella over this multitude of employment and 
training programs. 

.* 

Although several factors influenced this reorganization, a > 
major assumption in /the legislation of 1973 was that the Act 
would give local officials thC^exibility to match services to ^ 
L plients' needs and loca^l labor market conditions, thereby im- 
r proving service ef fectivenfess and countering tHe^unemploymeat . < 

¥ that is caused bfc discrepancies between employer&J. needs and 

job seekers 1 skills — so-called structural unempAojftnent . Control 
over the mechanises of plarttting,, administering 1 and delivering 
• employment and training ^services was decentralized, so that 
local "government officials could be free"r to decide whom to 
"serve and wha,t services £o ptpvide. Accordingly, CETA subsumed 
employment and training services under four titles. 
- * 

Title I, tWe Comprehensive Services*, title , authorized a 
wide range of employment and training activities. Among them 
were outreach, individual a3sessment, and counseling. On-the- 
job training was included, as was classroom training for'basic 
and occupational skills/ Training allowances, employment ex- 
pense allowances, development pf local labor market information, 
transitional public service programs, and supportive services 
* were all also provided lor., ^ 

Title tfl, the public employment programs title, authorized 
the creatiori^of transitional public service employment jobs for 
people unemployed and underemployed in areasf of substantial 
unemployment % > * . 

Title III, "Special federal Responsibilities/Special Target 
Groups, " mandated the Secretary of Labor to provide additional 
employment and training services to groups \?ith special need of 
such services. These included youth, offenders, people with no 
or only limited ability t<J> speak English, older workers, and 
^ other groups experiencing (particular hardship in the labor market. 

Finally, title IV continued the already existing Job Corps, 
.The Job Corps, originally (created in 1964, is a primarily resi- 
* * dential program for assisting disadvantaged youth in improving 
their emj/loyability in'thd labor market. 

^Thus we see that, even in the be'ginning, CETA was not com- 
pletely decentralized and jdec^iegorized . Only titles I and II 
of the 1973 Act gave contr'pl oX services to local authorities. 
Local flexibility in det Jfrtoinin^ service mix was truly opera- 
tional Only within title I. 

Focusing on the titles, however, does not give an entirely 
accurate picture of the changes th&t CETA instituted. In fiscal 
year 1975, $319 million was spent for title VI, a new public 
service employment prograrri to combat cyclical unemployment — 
the unemployment accompanying downturns in the business cyc^. 
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Even so, title I, the Comprehensive Services title, accounted 
for approximately $899 million, by far the largest proportion 
of the fiscal year 1975 CETA outlays. 

.1 

Since then, CETA has undergone major restructuring. The 
relatively straightforward mechanism for delivering employment . 
and training services was modified over the five-year period 
1973-78. CETA increased in complexity as purposes for the pro- 
gram multiplied and as more groups with specific needs were 
identified and targeted. After 1978, thdre were eight separate 
titles, and eleven titles or subtitles authorized the delivery 
of employment and training services. Exhibit 1 juxtaposes the 
1973 and 1978 titles with roughly similar services. \ 

As we see from the exhibit, the 1978 title iib was compa- 
rable to the 1973 title i^j the* Comprehensive Services component 
of the system. Title IIC, a small component , y authorized occupa- 
tional upgrading and retraining activities for entry level em- 
ployees and people facing impending layoffs, while title IID, 
roughly comparable to the old title IT, was a counterst ructyral 
sometimes called transitional, public service employment program 
for welfare recipients and people with low incomes or lonq-term 
unemployment. 

Title in continued the National Programs, detailing spe- 
cial Federal responsibilities to certain groups. it was almost 
the same as the original title Til, except that youth programs 
were moved to title IV and more groups were listed as requirinq 
special consideration. Title IV covered the youth programs, 
continuing those authorized under the Youth Employment and Dem- 
onstration Projects Act of 1977, the Job Corps, and the Summer 
Youth Program. 

Title VI, a countercyclical program, authorized subsidized 
public service employment during periods of high unemployment. 
Meanwhile, title VII, the Private Sector Initiative Program, ' ' 
provided for a demonstration program to increase private sector 
participation in employment and training activities' and to in- '"■ 
crease private sector employment opportunities for people who ■ 
are disadvantaged and unemployed or underemployed. 

' Finally, 'title VIII established the Young Adult Conserva- 

tion CorgS. It operated year round and enrolled both disadvan- 
taged and nondisadvantaged youth in conservation jobs in na- 
tional parks and forests and on other public land. L 

t 

. After the 1978 restructuring, the CETA system remained 

fairly well decentralized. Many services under the new titles 
were administered by the same local authorities who administered 
services under the Comprehensive Service title, but local con- 
trol in selecting target groups and services lessened. 

The Comprehensive Services title (title I in 1973, reauthor- 
ized as IIB in 1978) remained a major component of the CETA 
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Comprehensive Employment and Training 
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Act Titles in 1973 and 1978 Compared a/ 



CETA 1973 (Pub^ L. No/ 9 3-20 3) 
Title VI: General provisions 



Title I: Comprehensive hanp ower Services Est- 
ablishes nationwide program ot comprehensive 
employment and training services (training, em- 
ployment, counseling, assessment, placement) tor 
the economically disadvantaged, unemployed, or 
underemployed; administered by State and local 
government. 



Title II: Public Emplo yment Programs Authorize* 
a program of transitional employment for unemploy- 
ed and underemployed, providing *«^es In areas 
of substantial unemployment; training and manpower 
services to be provided whenever possible to en- 
able sioveaent into unsubsidized employment. 

T iM» IIIA: Special F ederal Responsibilities: 
Speci al Target Groups Provides for r/a tionally 
' sponsored programs and supervised manpower serv- 
ices to youth, offenders, people wlt\^ limited 
English, Native Americans, migrant arid/seasonal 
farmworkers, and o&ers particularly disadvan- 
taged in the labor market. # 



Tttle IT1P: Special Federal Respons ibilities: 
Research. Training, and Evaluation Authorizes 
research, demonstration, and evaluation programs; 
administered by the Secretary of Labor. 



Title IV; Job Corps Authorizes the Job Corps, 
a primarily residential program of education, 
skills training, and counseling for disadvantaged 
youth. 



Title V* National Commission for Manpower 

Policy 



rFTA AS AMENDED IN 1978 (Pub. I. No. 95-524) * 



Title I; 



Administrative Provisions 
1 



Tlt le UK: ^mprehensive Eap ^y""*"* , and Training 
^T^TT Fin ancial Ass istant Provisions 

Title XXB: "^m nreliens ive Employ ment and Training 
S^T ^T^ ^rvLa» lor th » Economically DTsldyaV 
ffsed" — Establishes nationwide program or compre- 
nlsTve employment and training services (training, * 
counseling, supported work, work experience, sup- 
ple Serviced for the economically disadvan- 
taged unemployed, underemployed, and people in 
school, administered by State and local government. 

Title IIC- rWore henslvc Employ ment and Training 
Ill.T^::. MpnrLin o and Retraining Authorizes 
Po^|^in1n^iai q assistance to public an priv- 
ate employers for costs associated with upgrading 
entry-level employees; permits prime sponsors to 
retrain people facing impending layoffs with lit- 
tle chance of equivalent future employment. 

Title IID- C omprehensive Employment a nd Training 
c^..^- g! Transitional Emplo yment upporUimt ies 
fnr rh. Economically Disadvantaged Authorizes a 
public service employment program for the econo- 
mically disadvantaged. 

/ 

Title IIIA: Soc ial Federal Resp onsibilities: 
g p^TvTMatlonal Prog rams and Activities Provides 
for nationally sponsored programs and employment 
and training services to youth, offenders, people 
with limited English, Native Americans, ^9^ant 
and seasonal farmworkers, Veterans, the handicap- 
ped, older workers, displaced homemakers, single 
parents, people lacking education c^*"^ 8 ' _ 
public assistance recipients, women, and others, ^ps* 

Title 'IIIB: Special Federal Re sponsibilities; 
Research. Training, and Eva luations. Lont inues re- 
search, demonstration, evaluation, ^nd laborTnar- 
ket information activities. 

Title IVA: Yo uth Programs; You th Employment 
Demo nstration Program Establishes demon strat ion 
T program to help' solve structural unemployment. 



National Commission for Employment 



Title IVB; Youth Programs : Job Corps Author- 
Ues the Job Corps, a primarily resiaentlal pro- 
gram of education, skills training, and counsel- . 
ing for economically disadvantaged youth. 

Tit le IV: Youth Programs: Summer Youtk Programs 
Authorizes pr«lme sponsors to conduct summer pro- 
grams containing useful work, basic educatioh, 
and employability development activities for 
economically disadvantaged youth. 

Title V: 
Pol icy 

Title VI; Countercyclical Public Servi ce Employ- 
me nt Program Establishes a program to provide 
temporary employment during periods of high unem- 
ployment; eligibility requires receipt of public 
assistance or unemployment In 10 of 12 preceding 
weeks and family Income at or below Bureau of 
Labor Statistics lower living standard. 

Title VII: Private Sector Opportunities for the 
feconomic allv Disadvantaged Authorizes a demons 
stration program to obtain more private sector 
participation In CETA efforts to assist the dis- 
advantaged; establishes Private Industry Councils 
to work with CETA prime sponsor! in assisting 
CETA participants to move to uniubsldlzed jobs in 
the private sector* 

Ti tle VIII: Young Adult Conservati on Corps 
Authorizes a year-round corptt of people 16-23 
years old to do conservation work on public land. 



a/Roughly similar titles are juxtaposed. 
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Comprehensive Services and Public Service Employment Outlays 
, for Fiscal Yean 1975-80 (in Millions of Dollars) a/ 



1975 1976 TQ1976 1977 1978 19?9 I960 

Title IIB-C 899.1 1,697.5 436.0 1,756.2 1,874.6 1,801.6 2,143.8 / 
Comprehensive Services b/ 

Tltle IID 519.2 550.1 398.5 1,137.5 994.8 1,738.2 1,856.6 
Counterstructural public 



Service Employment 

Tltle VI 319.2 1,866.3 198.4 1,698.9 4,769.4 3,2*5.2 1,778.1 

Countercyclical public 
Service Employment 

Titles IID and VI 838.4 2,416.4 596.9 2,836.4 5,764.2 5,023.4 3,634.6 

Combined Public Service 
Employment 



Source: U.S. Department ot Labor, Employment and Training Administration. 

a/Title designations are for 1978. Eitcal years 1975 and 1976 begin July 1; fiscal years 1977, 
1978, 1979, and 1980 begin October 1. TQ 1976, the transition quarter July 1 to September 
30, 1976, is a bridge between 1976 and 1977. 

b/Total costs include outlays to Prime Sponsors, Governor's vocational Education, State Employ- * 
ment and Trainina Councils, State Coordination and Special Services, and Governor's Linkaqes 
Grant. * 

system throughout fiscal years 1975-80, but its primacy was 
challenged by the growth of, the Puhlic Service Employment (PSE) 
titles (title II in 1973, titles IID and VI in 1978). Table 1 
shows that outlays for the combined pse titles exceeded outlays 
for the Comprehensive Services title for all fiscal years but 
1975. Moreover, the estimated numbersybf individuals served 
through PSE came close to those estimated for Comprehensive k. 
Services in fiscal years 1978 and 1979, as can be seen in table * 
2. Approximately one and a quarter million people were served 
under the Comprehensive Services title in fiscal years 4.978 and 
1979; almost as, many were served through the combined PSE titles. 

Soon after CETA became operational ' in July 1974,. the 
Emergency Jobs and Unemployment Assistance Act of 1974 (Pub. L. 

Table 2 • 

Number of Individuals Served Through Comprehensive Services and Public Service 
Emp^>yment Titles, Estimates for Piscal Years 197 5-80* a/ 





1975 


1976 


TQ1976 


1977 


1978 


1979 


1980 


^itle IIB-C 
up Comprehensive 
^ Services 


1,122,000 


1,731,500 


807,900 


1,413,600 


1 , 331, 500 


1,193,727* 
> 


1,113,844 


Titles IID and VI 
Public Service 
Employment b/ 


366,800 


584,860 


382,110 


"* 783,341 


l,Z07,O22 


1,105,199 


847,226 



Source: U.S. Department of Labor, Employment and Training Administration. 

a/Title designations are for 1978. Each total is the total current enrollment at the begin- 
ning of the period plus the additional new entrants throughout the entire period. Fiscal 
years 1975 and 1976 begin July 1; fiscal years 1977, 1978, 1979, and 1980 begin October 1. 
1977 976 '' thC tran8ition <J uarter Ju *y 1 t0 September 30, 197^, is a bridge between 1976 and 

b/Estimates for titles IID and VI exclude intertitle transfers. 
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No. 93-567) modified it. With this legislation, the Congress 
was responding to a deepening recession by adding the counter- - 
cyclical public service employment component in title VI. The 
original PSE title (title II of the 1973 Act) had been a minor 
component of the. system, creating jobs only in targeted areas 
Of the country with high unemployment. PSE became a nationwide 
activity, no longer confined to areas of high unemployment. As 
the recession worsened, the Congress enacted the Emergency Jobs 
Programs Extension Act of 1976 (Pub. L. No. 94-444)', extending 
public service employment and tightening the eligibility re-^ 
quirements. Early in 1977, under a new administration, public 
service employment was sharply expanded as part of an economic 
stimulus program. This rapid expansion shifted the nature of 
the CETA system significantly. The percentage of CETA outlays ,• 
for PSE nearly doubled, rising from 31 percent in 1975 to 60 
percent in 1978. 

By 1978, CETA could no longer be called an employment pro- 
gram for reducing structural unemployment by creating better 
matches between employers' needs and the skills of disadvantaged 
job seekers. With the addition and expansion of public service 

• employment programs, CETA had become, at least for a time, a 
dual program to combat two major dysfunctions of the labor 
market — both structural and cyclical unemployment. 

THE REFOCUSING OF CETA'S 

ELIGIBILITY REQUIREMENTS ' 

Along with the changes npted above, CETA's adult services 
were given rather complicated refocusing after 1973. This can 
be seen in the changing statements of purpose for the titles, 
in the changing eligibility requirements, and in the increasing 

• restrictions on the nature of services. In general, these 
changes were designed to target services for jtfults more .toward 
the disadvantaged unemployed and to reduce re&l or perceived 
abuses in the program. 

The pfirpose of the Comprehensive**Servi.ces tit^e in 1973 , as 
stated in the legislation, was 

' to establish a program to provide comprehensive man- 
\ power services throughout the Nation. Such program 
shaLA include the development and creation of job op- 
portunities and training, education, and other serv- 
ices needed to enable individuals to secure and re- 
tain employment at their maximum capacity. ,(Pub. L. 
No. 93-203, sec. 101) 

The regulations that implemented the legislation specified that 
individuals qualified for se'rvices had to be economically dis- ^ 
advantaged or unemployed or underemployed. People defined as 
economically disadvantaged were members of families receiving 
cash welfare payments or Whose" annual income .did not exceed the 
poverty level established by the Office of Management and Budget. 

O 11 ^ 
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v.-*. "authorization of CETA in 1978 tightened these "eligi- 
bility requirements, individuals seeking services under title 
IIB were henceforth required to be both economically disadvan- 
taged and unemployed, underemployed, or in school. Thus, while 
people had been able to qualify for CETA services under the 
Comprehensive Services title in the early years simply by virtue 
of relatively brief unemployment, after 1978 all participants 
were required to meet an income test. Moreover, public service 
0 employment was excluded as an allowable activity under title iib, 

t A more^ pronounced shift toward serving the disadvantaged 
occurred for PSE title II (HD in 1978). The stated purpose . 
of this title m the 1978 Amendments emphasized economic dis- 

?Q^ n ^ a ?\ a ! Part ° f the criteri * 'for .eligibility whereas the 
1973 Act had not. The 1973 Act had said that the title was .' 

to.provid-e unemployed and underemployed persons' with 
transitional employment . in job's" providing needed public 
services m areas of substantial unemployment a-ncTV wher- 
ever feasible, related training and manpower services 
• to enable persons to move into [unsubsidized employment]. 
(Pub. L. No., 93-203, sec. 201) - 

Areas of 'substantial unemployment were -defined as areas with a 
rate of unemployment equal to or greater than 6.5 percent for 
three consecutive months . Under the 1978 Amendments, programs 
authorized by title HD were 

to provide economically disadvantaged perso ns who are 
'unemployed with, transitional employment in jobs provid- 
ing needed public services, and related training and 
services 'to enable such persons to move into [unsubsi- 
dized employment or training]. (Pub. L. No. 94-524, 
sec. 231) 

f 

The length of unemployment 'necessary to qualify an individ- 
ual for a title iid job also changed. In 1973, it was' .necessary 
to be unemployed only for 30 days. The 1978 Amendments > required 
unemployment for at least 15 weeks before enrollment, but the 
regulations later revised this to 15 weeks of the preceding 20. 

♦ After 1978, PSE title IID was called the counterstructural 
PSE title. The 1978 Amendments stressed the need to increase 
training opportunities to enhance the employability of title 
IID PSE participants. The propprtion of the title, IID alloca- 
tion to be used for training in each fiscal year was required 

° . l6SS than 10 P er ^ en t in 1979, 15 'in 1980, 20 in 1981, 
and 22 in 1982. Before 1978, title II public service employment 
was authorized only in areas of substantial unemployment. 'The 
1978 Amendments removed this restriction so that the program 
could serve the economically disadvantaged in all areas. 

In summarizing the major "legislative and regulatory chan- * 
ges, it is apparent that the focus of the original PSE cbmpo- . 
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nen't of CETA shifted after 1978 to people who were economically 
disadvantaged and had significant historj.es of unemployment. 
Additionally, the prime spofr-sors — the units of government 
through which services were to be delivered — were Required to' 
increase their 1 efforts to provide training in combination 
with subsidized jobs. This, of course, gave more emphasis to 
the transition of participants into unsubsidized employment. 

Title VI of the public^ service employment provisions 
also underwent fairly dramatic changes in the course of its 
existence between 1974 and 1978. The Emergency Jobs and Un- 
employment Assistance Act of 1974 had as its stated 'purpose, 
to provide ^ 

" transitional employment for unemployed and underemployed 
•persons in jobs prqviding needed public services, and 
training and manpower services related to sugh employ- 
ment which are otherwise unavailable, ,and enabling such 
persons to • move into [unsubsid ized employment] . (Pufcu_L. 
No- 93-567, sec. 602(a)) » f 

[n general, enrolled were required to have been unemployed for 
it least 30 days before application or to be underemployed, and 
Iditionally they were require^ to reside in the prime sponsor's 
;isdiction. ( N 

When title VI was expanded in 1976 by the Emergency Jobs 
Programs Extension Act (Pub. L. No. 94-444), the jearlier eligi- 
bility criteria were permitted to remain in effect for 50. percent 
^ of the positions already existing, but more stringent criteria 
were set for the remaining 50 percent and for all positions in 
new PSE projects and activities. People enrolling under these 
new and stricter criteria had to be economically disadvantaged 
or a member Of a family whose- total income was at or below 70 
percent of the BhS lower living standard. Additionally, an 
individual had 'to fe^e unemployed during .15 of the 20 weeks pre- 
ceding application or had to have exhausted unemployment bene- 
fits os had to have a family receiving Aid to Families with s ^ 
^Dependent Children..' - r 

The 1976 Act required prime sponsors^/ iacal program agents , 
to create n$$&public service employment positions' in projects of 
no more than 12 mpnths duration rather thin in ongoing activities. 
Projects were defined as activities that produced a specific 
product, had a definite time frame/ and were not activities that 
would have been done in" the absence of PSE funds. Ttffc-J.976 Act 
also established a national average Annual public service employ- 
ment wage of $7,800, with a maximum of $10, OOpr^JThe time limit on 
projects was meant to prevent substitution and' dis>lacement--that 
is, the substitution of PSE funds for local money and the displace- 
ment of workers on the regular payroll by subsidized PSE workers: 

Previously, the length of time that enrollees could re- 
* main in PSE jobs was unspecified and cases were reported 
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ojL_persons who had been hired under the Emergency) Employ- 
ment Act-of 1971 who were still on the CETA payroll. 
(Mirengoff, 1980, p. 30) ' 

Requiring prime sponsors to create PSE jobs in special projects 
of limited duration was a step toward curbing 'these problems. 

In 1978, the CETA Amendments made eligibility criteria for 
title VI PSE enrollees a little more lenient but tightened the 
wage restrictions. Participants were now required to be unem- 
ployed for only 10 of the 12 weeks preceding application. The 
family income requirement was relaxed slightly; to 100 percent 
of the BLS lower living standard. The restriction on PSE wages 
was lowered to a $7,^00 average wage rate, still with a $10,000 
maximum, while adjustments were allowed in some high wage areas. 
The limitation on duration of projects was relaxed to 18 months, 
and individual participation was limited to 18 months within a 
5-year period. Congruent with its role as a countercyclical 1 
program component, training activity received much less emphasis 
for- title /VI than was the case for IID. 
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In short, these changes in Comprehensive Services and Public 
Service Employment concentrated- CETA' s focus on the disadvantaged 
and laid stfcess on providing training opportunities for • PSE par- 
ticipants r -In addition, the operational restrictions on PSE were 
designed to*;reduce program abuses and prevent fiscal substitution 
of PSE money for local funds. Knowing what these changes were' 
and when they happened is important for interpreting information 
about the characteristics of who was served, what the results were 
for participants, -and how effective programs were and for estima- 
ting the extent of substitution and displacement. 

CETA'S SERVICE DELIVERY MECHANISM— 
THE DIVERSITY OF PRIME SPONSORS 

CETA employment and training services delj^red by State and 
local governments operate primarily through the%echanism called 
"the prime sponsor." In general, prime sponsors are units of 
government— cities, counties, consortia of cities or counties, 
and States— that represent at least 100,000 people. Applicants 
for prime sponsor must design comprehensive service* plans for 
t their jurisdictions and submit the plans to DOL for approval. 
Approximately 475 prime sponsors currently deliver employment and 
training services under CETA, and there 'are enormous variations 
1 !^ their characteristics and circumstances — not: only of the prime 
sponsors but of the kinds afc service they^eliver as well. 

Some prim^fc^onsors coyer a single cit'y or county; some 
cover several e^Bfcor counties; some cover a combination' of 
'cities and countie^^^rough a consortium of local government 
units. A few prime sponsors are statewide prime sponsofb . Some 
are "balance of State'' prime sponsors and cover all the areas in 
a State not in the^. jurisdictions of others. The catchment areas 
of prime sponsors^ thus differ -in the degree of their geographical 
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spread, in their character as urban or rural, and also in terms , 
of unemployment level and the structure and' size of the local 
labor market. This diversity greatly complicates the evaluation 
of the effectiveness of XT ETA services. 

* 9 

Prime sponsors differ further in their service delivery 
structured and the mix of employment and "braining services they ^ 
provide. Soi^e 'prime sponsors elect to deliver all services 
thiroi^gh their own staffs, while others use subcontractors for ^11 
.or part o*f their service responsibilities. Estimates of the num- 
ber of prime sponsor CETA subcontractors nationally run as high 
as' 55,000 and include school systems, other government agencies, 
conuriunity-baied organizations, riQnprofit organizations, and pri- 
vate businesses. Thus> the Simplification obtained nationally 
by reduc^Qjg the number of contracts DQL administers directly is 
sonyewh^t counterbalanced by the large number of contracts exe- 
cuted locally between primes-sponsors ajid their subcontractors. 

_ ajor reasojv^or CETA was t£> decategorize and 
decentralize employment an<J training services in order to permit 
local flexibility, it is not surprising that the mix of services 
varies widely among prime sponsors. One may emphasize classroom 
training, perhaps as a function of the availability of such 
} training resources in tl\'e community. Another may provide a J 
substantial amount of 'on-the-job training because its ar.ea's 
employers aire receptive to such efforts. Yet others may ti^y to 
provide an even mix of services . "Moreover , selecting a servitae 
mix is the product of many considerations, including staff phiV 
losophy, the interests of local community groups, judgments about 
the needs of local enrollees, assessments of what is available\ 
among community resources,- and anticipations of the levels and 
types of job openings. For example, a prime sponsor in an urban 
area of high fiscal stress may find it difficult to develop brain- 
ing slots with private employers and thus put more emphasis on 
work experience than a prime sponsor in an area with less fiscal 
stress. 

This heterogeneity of CETA at the local level creates prob- 
lems in assessing overall CETA effectiveness nationally and in 
making comparative statements about the effectiveness of dif- 
ferent service types. National comparisons of the effectiveness 
of different service types are likely to be confounded with the 
characteristics and circumstances of prime sponsors. In compar- 
ing the effectiveness of on-the-job and classroom training, for 
example, analysts may unintentionally also contrast the effects , 
of other characteristics of prime sponsors, characteristics that 
may be associated with their decisions to emphasize oc their 
ability to provide some services rather than others. - 

CETA' S' SMALL SIZE RELATIVE 
TO THE UNEMPLOYMEN T PROBLEM , 

! * ' ~~ 

Between 1973 and 1980, the size of the U.S. civilian labor 
force, the number of people employed, and the^humber of people 
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^employed all increased^ dramatically / Thl size of the^labo;: 
force rose by 18 percent 2 -- f rom 88.7 millioir to 104.7 million 
workers. The nuuber of people emplcfyed rose .by 15 percen^--f row 
84.4 /lilXion to 97.3 million. * The number of people unemployed 
(including those aged 16 or older) rose by 72 percent — f rorn 4.3 
* -million to 7.4 million. One of t«he most striking reasons for 
these increases was that the career and work patterns of wo'iuen 
changed. Female labor force participation rose from 45 percent 
to 52 percent between 1973 and 1980. " , 

Actually, in this perio*d,the unemployment \ate increased 
dramatically and then decreased s lowly before increasing a«jain. 
In 1973, the unemployment rate Stood aft 4.9\percent. In 1975, it 
rose to 8.5 percent, decreasing slightly each year thereafter 
until 1979, when it stood- at 4 5.8 percent. In 1980, it rose again 
to 7.1 percent . »• 

^ Over the years 1973-30, the % reatest number of people offi- 

cially classified as unemployed occurred in 1975; there'were 7.8 
million unemployed in an average month in that year. The lowest 
number was in 1973, with 4.3. l nillion. By 1980 the number stood 
at 7.4 million, ^representing a dramatic change over the figure of 
the year>before, 6.0 million peopl e^. uneui&loyed in 1979. Thus, 
the absolute numbers of people Wieinp I oyed dropped significantly 
from 1975 to 1979, but 1980 unemployment came close to matching 
unemployment in. 1975; the deepestVecessi<onary year during tho 
eight years of CtTA. \ 

The overall statistics for employment and unemployment 
offer a summary picture of aggregate labor farce activity, but 
they, do not ayow for analysis of the differing employment 
prospects'by age, race, gender, and" other classifications . When 
unemployment rates are broken-down into sociodenographic sub- 
groups, they are seen to vary widely.* The burden of unemployment' 
falls unequally in the United states, and the patterns d-id not 
change- significantly between 1973 and 1980. 

Figure 2 shows, for example, that youths 16 to 19 years old, 
especially nonwhites, had the highest rate of unemployment in*-.. 
1973-80. In 1977, the unemployment rate Cor nonwhite youths was 
38 percent, • compared to 15 percent for. white youths,. The" non- 
white adult unemployment rate (for people 20 and older) was con- 
sistently^igher than the rate for white adults between 1973 and 

1 "80 • * y 

Other statistical breakdowns reveal other differences in un- 
employment rates. in 1975, when overall unemployment was at '8.5 
percent, teenagers averaged* 19. 9 percent unemployment, blue- 
collar workers averaged 11.7 percent, women -aged 20 and older 
averaged 8 percent, afKl men aged 20 and older -averaged 6.7 per- 
cent. Married -mfen living with their wives had the lowest unem- 
ployment Mte at 5.1 percent— a relative position they held con- 
sistently. Women maintaining families, on the other hand, had 
an unemployment rate of 10 percent. 
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Figure 2 

Unemployment Rates Overall and by Age and Race Subgroups 
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Figure 3 ^ 

Number of People Unemployed and Number of People Unemployed Mori Than 26 Weeks 
Versus Estimated Numbers of Total People Served Through Comprehensive Services 
and Public Service Employment Titles 1973 80 
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Estimated number of people Estimeted number of people served 

servetkthrough through Comprehensive Services 

PSE titles lib. VI , . title IIB-C » 

Unemployed more than 26 weeks 




1973 



1979 - 1980 

Calendar years 



EttimAttt of numbttt ol people unemployed were obUinrd fiom thr Bureau of L*bo* Suttttict of the Department 
of Labor and ate plotted at the end of Ihe calendar yMi Ettimalei of numbcii of people leived through Compre 
henme Service* end f*ubhc Seivice Employment miu appear »n table ? of thu report and are plotted it the end 
ol the fuc*l V*ai f Vein 1975 and 1976 tt*4 June 30 fiicat yean 1977 thiou«h 1910 end September 30 The 
transition quarter for 1976 thai I thiouth September 30 I97<> •« included in fiKal year 1977 



Under CETA legislation, certain titles and programs are 
meant, as we have seen, to address problems of cyclical and 
t^ U ^cn?l u y"Pj°» nt » ^clical unemployment being viewed as 
tne result of a decrease in aggregate demand for the economy as a 
whole. Structural unemployment is viewed as the result of a more 
permanent mismatch betweerf the skills available workers have and 
tfte skills the labor market demands. People are generally clas- 
sified as structurally unemployed if they are out afi work for 
ma ^^? an 26 weeks. During 1973, 1.4 million people met this 
definition. The figure rose to 3.4 million in 1975, dropped to 

1980 I/ 10 " in 19?9, and again exceeded 3 million in 

Figure 3 presents . information on the cumulative numbers of 
people unemployed because of structural unemployment or other 
reasons during each year 1973-80. Comparing these numbers with 
the estimated numbers of people served through CETA ' s Comprehen- 
sive Services and PSE titles, we can see in the figure that the 
magnitude of the unemployment problem greatly exceeded the capac- 
ity c* CETA adult services to address it. In sum, while there- 
were wide swings in the unemployment rate and in the absolute 
numbers of people 4 looking, for work, the relative ordering -of var- 
ious sociodemographic subgroups remained constant, and neither 
cyclical nor structural unemployment decreased noticeably over 
the period. In fact, in 1980, more than twice as many people 
were classified as structurally unemployed than when CETA was 
enac,ted in 1973 . Moreover, the number of people who would be 
likely to find jobs if ..overall aggregate demand had increased 
enough— the cyclically unemployed— did not decline significantly. 

PROBLEMS OF RECONCILING LOCAL • ' 

AND NATIONAL OBJECTIVES f 

Decentralizing employment and - training services, transfer- 
ring responsibility to local governmental authorities, introduced 
a whole new set of administrative pressures. Whereas before 1973 
deliverers of services had negotiated direct}y with DOL for con- 
tracts; after CETA's enactment local prime sponsor managers were 
responsible for , negotiating all needed service contracts. Com- 
pounding the problem after CETA's enactment was the fact, that 
local CETA administrators had very little time to sort out their 
priorities and select subcontractors. Beginning iiKJuly 1974 and 
following quickly with the addition of PSE title VI iH December 
1974, this stress increased. Prime sponsors who possessed little 
experience in the intricacies of such programs but who were 
sensitive to the needs of the various constituencies in their 

1/Unemployment longer than 26 weeks is a somewhat arbitrary in- 
t dicator of the number of people whose skills do not match em- 
ployers' needs and is also affected by the length and depth 
°. r ^5 es sion. Thus, it is not completely accurate to offer 
this number as a firm estimate of the number of people struc- 
turally unemployed in the United States. 
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.communities often fell back on already existing employment and 

training frameworks . \ 

t 

Although it was anticipated that the communities would hold 
local program administrators accountable for the effectiveness 
of programs and that this, in turn, would be useful in bringing 
about effective service delivery systems, it turned out that 
prime sponsors were often held accountable in unforeseen ways 
also. For example, they had to cope with interest groups at- 
tempting- to gain funding for specific subcontractors — some with 
histories of good performance and some without— and they had to 
demonstrate concern for certain constituent groups in their com- 
. munjfi.es, perhaps sometimes at the expense of less vocal but 
equally needy groups. 

Throughout the. history of CETA, DOL has encouraged prime 
sponsors to coordinate with already existing service providers 
and to use community-based organizations. Prime sponsors, on the 
other hand, have sometimes deemed it unnecessarily troublesome to 
refuse funding to or to remove funds from an ineffective or .poorly 
managed subcontractor, particularly when the subcontractor repre- 
sents a powerful constituency in the prime sponsor's community. 
In other words, selecting the most effective mix of services and 
the best service deliverers had to compete with the priorities of 
local political agendas. 

Divergence between local and national objectives has 
received the most attention with respect to the issue of substi- 
tution of public service employment funds for local money. CETA 

• legislation has been designed to preclude State and local govern- 
ments from using PSE funds to pay workers who are already on the 

' payroll and to prevent the displacement of regular State or city 
workers with people hired under the PSE program. Nevertheless, 
the effect of recession on State and' local tax collections some- 
times has been to put local governments in the uncomfortable 

( positiorvof having to lay off regular employees while at the 
same time hiring only new employees into the PSE jobs. In many 
instances, humanitarian concern for the laid-off employees 
strained compliance with Federal regulations. We mention this 
only to point out that local objectives for CETA may differ in 
many ways from the program's national objectives and that- it may 
sometimes be difficult to reconcile them. > 
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CHAPTER 3 

CONSIDERING ALTERNATIVE BASES 

I . * 
FOR EVALUATING CETA'S EFFECTIVENESS 

Assessing the effectiveness of employment and training prQ J 
grams is a complex task finder any circumstance. For a program 
that has pronounced loccJl variation, as CETA .does , the task is 

Sfferef^^ni CUlt ;^ S r tementS ° n P ro ? ram effects can seldom be 
offered without qualification. .Evaluation studies at best serve 
to provide background information for informed decisionmaking 
rather than firm answerb . In this chapter, we point to topics 
m the employment and training evaluation, literature that are * 
relevant to kinds- of information we present in subsequent chap- 
ters or this report. In discussing the evaluation of CETA" adult 
services, we review evaluation criteria and present an outline of 
the strengths and weaknesses of relevant evaluation designs. 

IDENTIFYING THE APPROPRIATE C RITERIA 
FOR EVALUATING CETA 

A variety of both economic and noneconomic benefits have 
been suggested for- employment and training programs, and gener- 
ally such programs seen as benefiting both program partici- 
pants and society. Relationships among perceived benefits are 
therefore, complex. They may be associated, for example, with 
the period of program participation, with the period after par- - 
ticipation, or with both. Day care services represent wi thin- 
program benefits to/participants, reduced dependence" is a post- ■ 
program benefit to both participants and society, and increased 
earnings may occur ^both within and after program participation. 

Further, the relationships among benefits are complex . in 
that some are direct while others are indirect. Ancillary serv- 

tn 6 ^^ ke f 111 ? C fl e constitute direct benefits, while a reduction 
in crime stemming/ from more stable employment is an indirect bene- 
fit; Similarly, /benefits directed toward one group may translate 
indirectly into benefits for others." For example, increased 
earnings for program participants may translate into benefits for 
local governments through increased tax revenues. Alternatively 
benefits for onk group sometimes involve costs to others.' The— ' 
payment of training allowances is a benefit to- the participant 
but constitute^ a cost to the taxpayer. Exhibit 2 presents a 
rough classification of benefits by type and recipient. ' 

Using all these as criteria to evaluate CETA would be both 
prohibitively expensive and perhaps redundant, since many of 
them appear to be closfely related. For example, increases in 
participant /earnings and in employment stability seem likely 
proxies for /many of the other benefits. Most evaluations of 'em- 
ployment and training programs have, in fact, been confined to 
assessments/ of the economic effects, particularly in terms of 
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Exhibit 2 



Proposed Economic arid Noneconomic Benefits 
from Employment and Training Programs 



FOR PARTICIPANTS 

Economic benefits 

Increased wages*and earnings 

Training allowances and wi^hin- 

program wages 
Training and education 
Increased employment stability 
Better housing 
Ancillary services — health 

and dental care, day care, 

t ranspor tat ibn , per sonal 

counsel ing 



Noneconomic benefits 

Eased entry into the labor force 

Acquisition of work experience, 
work history, better work 
habits, greater work satis- 
faction and motivation 

Acquisition of skills and basic 
education 

Alleviation of boredom 

Independence and improved self- 
esteem 

improved family Hfe 

Improved social status 



FOR SOCIETY 



Economic benefits 

Increased employment 

Reduced unemployment 

Increased GNP 

Increased tax revenues 

Increased value of goods 
produced 

Decreased administrative costs 
and transfer payments for 
other social programs * 

Reduced cr ime 

More stable pr ices x 
Increased skill level of labor 
force 

Noneconomic benefits 
More equitable income distri- 
bution 

Help to the disadvantaged 
increased soc ial stability 
Fostering of good will 
Better race relations 



Source 



See C. R. Perry et al The impact of Government Manpower 
' programs in General and on Hif^tW T^md^mmen (Phila- 



delphia: 



and M. E. 



University ot Pennsylvania/ 1975)/ 

pf Employment-R e 7 — 
The Upjohn Institute for 



Borus, Measur i'nq the impact of ^Pl°yp e n *:gg*f ^ g^ ial 
Program's (Kalamazoo, Mich"?: 



Employment Research, 1979 J. 



earnings, from the perspective of the program participants. One 
exception is- the recently completed evaluation of Job Corps, a 
youth program outside the scope of this report. (Mathematica , 
1980) A few attempts have also been made to assess the macroeco 
oomic effects of employment and training programs, and we shall 
discuss issues associated with these in chapter 8. 

Identifying the appropriate evaluation criteria for CETA 
adult services requires both' attention to the legislative objec- 
tives for CETA and! an examination of what is known about the 
nature of its services. Further, it is necessary to determine 
what evaluation criteria are consistent with each service type 
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and whether these criteria and the program's legislative objec- 
tives are congruent . 



™* J f WS b6gin with the over all statement of purpose in the 
CETA Amendments of 1978, we find a very specific statement of 
what CETA is to accomplish: 



It is the purpose of this Act to provide job training 
and employment opportunities for economically disad- 
vantaged, unemployed, or underemployed persons which 
will result in an increase in their earned income . . . . 
(Pub. L. No. 95-524, sec". 2) 



) 

►The emphasis is clearly- on participants realizing gains in ' 
earnings. 

% In the paragraphs below, we describe four types of CETA 

adult service and discuss the appropriateness of the earnings 

.criterion— that is, of assessing the effectiveness of services bv 
measuring changes in the participants' earnings. Three of these 
services— classroom training, on-the-job training, and work expe- 
rience—are commonly termed "employability development activities" 
because they are' designed to increase an individual's prospects 
for obtaining unsubsidized employment by teaching the individual 
a skill, inculcating a< positive work attitude, or building a work 
history. in other words, the individual is supposed to take away 
something new from having participated in such activities. (We . 
discuss the adequacy of CETA employability development plans in' 
our 1982 report Labor Should Make Sure CETA Program s Have Effec- 

tive Empl oyability Development- Systems ; see U.sT GAD, iqr? \ The 

fourth service we discuss, public service employment, is assumed 
to emphasize employability development less, although it does 
show some concern' for this, especially considering the recent 
emphasis, on training in title HD. 

Classroom training under CETA refers to the transmission in 
a classroom or institutional setting of basic academic skills or 
of technical -information required for specific occupations. It 
nas been described as most appropriate for occupations in which 
50. percent or more of the required training involves acquiring 
cognitive skills. Thus, CETA classroom training is intended to 
combat structural unemployment by. assisting disadvantaged indi- 
viduals in acquiring new and sought-after skills. 

Classroom training is, therefore.,, a mechanism _fp'r increasing 
the match between employers and job seekers. Prime sponsors are 
required to" provide assurances that classroom training programs 
are designed for occupations in which skill shortages exist. Be- 
cause classroom training transmits information for" enhancing oc- 
cupational or educational skills, it may be expected to -demon- 
strate effect lveness as measured by economic evaluation criteria 
Uke earnings gains. . This is more true for programs with occu- 
pational skills content than for those with basic education con- 



On-the-jo b training refers to the transmission of occupa- 
tional skills within a work setting, usually in the P"™*? 
sector. Trainees acquire skills by performing the actual tasks 
of a job, the assumption being that a trainee learns best by be- 
?ng in an actual workplace and usi^g the employer's Pf°^ures 
and tools. There is no clear consensus on the immediate objec 
tives of on-the-job training, however. 

Some see the training as secondary, defining the success of 
the service in terms of the hiring and retention of trainees. In 
this" case, the emphasis is on the trainees" entry "to the labor 
market in a manner that will permit upward movement. Others see 
tL employers' retention of trainees as secondary, defining the 
success of the service in terms of the acquisition of skills and 
focusing on the benefits to human capital. In either case the 
exDOSUr e of participants to normal job settings, their acquisi- 
tion of skins while on the job, their potential for being re- 
tained on the job at the end of the training P^iod, and the 
success of on-the-jqb training efforts for unskilled women in 
the 1940' s, all increase the expectation that CETA on-the-job 
training will prove to be one of trte most effective services 
across a variety of measures. 

* 

Work, expe rience in CETA consists of a short-term or part- 
time subsidized work assignment with any employer other than a 
private for-profit employer. It has been ^s^ 1 ^ ap- 
propriate for. people who either have never worked or have re- 
cently not been working for an extended period of time. Employ 
a5li?y is assumed to increase as basic occupational skills are 
acquired,, work motivation improves, and job retention skills are 
acquired . 

Work experience may be used to increase the labor force at- 
tachment among people who have difficulty est •«i-^iSp2T n 
in the first place— like ex-offenders, youth, the handicapped, 
and the aged. It is also used sometimes berime, sponsors as a 
"holding mechanism" to maintain people while other > opportune, 
are created for them. Because work experience is' intended to be 
used for the most disadvantaged of CETA enrollees, and becaus.e 
it sometimes serves as a holding mechanism, lower ex P^t*tions 
are held for its effectiveness on economic measures relative to 
other types of service. 

Public service employment activity in CETA refers to the 
creation of subsidized, public sector employment opportunities- 
jobs that can be viewed in terms of countercyclical or counter- 
structural objectives or both. When viewed as a device for 
conbatinq structural unemployment, job creation stresses the 
development of skills conducive to We employees' unsubsidized 
employment, and a temporary job can be seen as a springboard to 
more permanent employment (as we discussed m our 1979 report on 
PSE transition problems, Moving Parti cipants f r om Public Service 
Employment Programs into Unsubsidize d Jobs Needs More Attention- 
see U.S. GAO, 1979) • ■ 



m™« h f n ? SE - S Viewed as a dev ice for combating cyclical unera- 1 
pSHal'olTh 1 ^^ 01 "-? r f c f SSi0n ' the e»Ployabili?y development 
?2I * * ac ^ 1V1 ^ takes a - back seat to the need to main- 

tain people during temporary setbacks, where lo<£l economic con- 
ditions are consistently poor or where there are large numbers of 
^n n , 1CallY - Unempl ° yed ° r hard-to-employ individuals? PSE may be 
seen as an income maintenance device or as a way to put people to 
- work doing something useful/, and the ob^ctive^K moving pedple 
^nLnr SU ^ S ld ^ zed employment may be ignored. Finally, local gov- 
or eJLnrf^f Wlth ' shrinkin 9 tax bases and requestsfor continued 

" n d 0 ^rvices may use PSE fuSds in the same way they use 
Federal revenue sharing— to ease the local financial burden of 
maintaining current service levels or expanding them. 

Using earnings gains as an evaluation criterion for publiic 
service employment services is appropriate for title niTbut 
largely to the extent that iid involves acquisition of new skills 
along with a subsidized work opportunity. Using this criterion 
° 'J l " e ^ I « questionable. Indeed, since title VI was origi- 
nally designed to combat cyclical unemployment by providing tem- 
porary subsidized employment for people displaced by recession, 
PSE may reasonably be expected merely to permit people to main- 
tain their earlier earnings levels. One could even argue that 
the maintenance of earlier earnings levels is too stiff a crite- 
rion for evaluating title VI PSE. The confusion in expecta- 
tions for public service employment is summarized in the 
following statement: 

Questions that need to be addressed include: Can public 
service employment be a program for all seasons? Can it * 
simultaneously be effective as a countercyclical device, 

^_av^cleJEor_jr^^^ unemployed,. _ 

as a tool for income maintenance, and as a means of as- 
sisting financially hard-pressed State and local govern- 
ments?/ (Mirerigoff, 1980, p. 14) 

As we review data, on these four types of service in later 
chapters, it should be remembered that the services a CETA par- 
ticipant receives do not necessarily conform to our descriptions, 
which have emphasized the differences between service types 
rather than their similarities. m actuality, day-to-day activ- 
ities of two enrollees in two different service types may resem- 
ble one another more closely than the activities of two enrollees 
• m a single service. Because prime sponsors may structure pro- 
gram components flexibly and offer combinations of employment, 
training, and ancillary services, any one individual may actu- 
ally receive several kinds of service simultaneously even while 
being recorded in only one reporting category. This variation 
and overlap among service types means that comparisons of service 
types should be interpreted cautiously. ? 

In the rest of this chapter, we concentrate on various ap- 
proaches to assessing the effectiveness of adult-oriented CETA 
services largely from the perspective of the program participants. 



Thus, we discuss some of the methodological issues relevant to 
interpreting the information that we presentj.n later chapters.' 
The major evaluation issues pertinent to this review of CETA 
adult services are (1) the extent to which short-term outcome 
measures are predictive of long-term changes in earnings and em- 
ployment, (2) the extent to which postprogram benefits realized 
by participants can be attributed to program participation, and 
(3) the extent to which conclusions can be drawn about the rela- 
tive effectiveness of different types qf CETA services-. 

MEASURES OF SHORT-TERM OUTCOME 
AND LONG-TERM PROGRAM IMPACTS — 
ARE THEY RELATED?" 

' ., ' 

The ability to identify short-term outcome measures that can 
predict long-term program impacts is crucial to our ability to 
monitor CETA program performance in a timely way. Most short- 
term measures used in employment and training program evaluations 
have been economic measures, excluding noneconomic measures such 
as job satisfaction and attitudes toward work. Some have been 
based on participants' status at the time of their termination 
from the program— defined variously as rates of positive termi- 
nation, unsubsidized employment, and private sector placement. ^ 
Acceptable reasons for positive termination are entering employ- 
ment, including the military, attending an academic or a voca- 
tional school or another employment and training program full 
time^ and completing a program that does not involve job place- 
ment as an objective. t Other economic measures that are used 
frequently refer to experiences during the first 30 days after 
- termination—accounting for such things as number of days in 
employment, hours worked per week, and earnings per week. Still 
others refer to changes in an individual !s status, comparing 
circumstances before and after .program participation—that is, 
changes in wage rates, weeks worked, or employment status— and 
sometimes use data from short-term followup efforts. Approaches 
like these to monitoring employment and training services are 
attrac^ve because they cost little and appeal to common sense, 
but they are severely limited in the quality of the information „ 
they provide . 



It is important to^onsider the information obtained with 
placement rate data, for example. Placement rates are especially 
important because many prime sponsors use them to assess their 
program and because DOL mandates that placement rate data be col- 
lected and reported annually as part, of its prime sponsor moni- 
toring. Placement rates are therefore commonly used as short- 
term outcome measures. and are available nationally for CETA 
titles. For this reason, we have treated the placement rate 
variable in some depth. 

Although it might seem logical to assume that high place- 
ment rates for a particular program or service indicate program 
^ effectiveness, when we consider the meaning of placement rates- 
more closely, they become ambiguous. Knowing what percentage of 
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people have been placed in employment conveys no information 
about the quality .of those placements. What proportion of people 
have been placed in unstable low wage jobs? What proportion of 
the nobs is related to the skills training the .people received in 
the program? To what extent are prime sponsors serving the less 
disadvantaged (sometimes called "creaming") so that a high place- 
ment rate reflects the characteristics of the participants rather 
than the effectiveness of the Service? 1/ To what 'extent are hiqh 
placement rates a function of good local economic conditions? 

M Parallel -questions can be raised regarding lot placement 
spates. They may be a function of prime sponsors complying with 
. DOL instructions to serve the most disadvantaged among CETA appli- 
cants or of efforts to place people only in jobs of reasonable 
quality— jobs that may«,help them move out of the poverty cycle — 
or of poor economic circumstances. Further confounding the use * 
of this measure is that some prime sponsors place CETA terminees 
in a holding category for 30 days, even when they have been placed 
in a job; an individual who abandons the job during the 30-day 
period remains counted as an enrollee and the 'participation in- 
terruption is not noted. in this circumstance, reported place- 
ments refer only to people who have remained on the job for 30 
days. This is a very different definition of placement from 
that used for people listed as placed (and therefore terminated) 
on the first day they move into employment. Finally, low or hiqh 
placement rates may indeed reflect program effectiveness— or the 
effectiveness of the job development component of CETA — but they 
are subject to multiple and competing explanations, some of Which 
are consistent with program effectiveness while others are' not. 

Surveying the , literature reveals four attempts to validate ? 
short-term performance indicators for employment and traininq 
programs, summarized in exhibit 3. The earliest, by Borus in 
1978, explored the relation of 19 different short-term outcome 
variables (including employed 30 days after leaving the progxam, 
average weekly hours worked 30 days, after leaving, and chanqe in 
wage rate given rates before and after program participation) to 
five long-term measures of effect (1974 annual earnings, number of 
weeks worked, amount of public assistance received, amount of Un- 
employment ; Insurance payments received, and educational attain- 
ment). Borus used data on 242 participants in pre-CETA programs 
around Lansing, Michigan, and calculated the long-term net effects 
of participation against a. comparison group of applicants who « 
participated briefly or not at all; he found little or no relation 
between the short-term outcome variables -and long-term net effects 
of-, the program. He concluded that 



1/In a recent review of the Work Incentive Program, for example, 
researchers found that the State performance indicators of 
"number of , job entries per staff" and "job retention rate" were 
associated with the characteristics of registrants. Character- 
istics with the strongest relationships were educational level 
and race. See Mitchell, Chadwin, and Nightingale, 1980, p. 313. 

S . 
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Exhibit 3 

'Summary of Studies Relating Placement to Earnings Gains 
(Keyed to List of References in Appendix II) 



STUDY 

Borus, 
1978 



Gay and Borus* 
1980 



Finifter, 
1980 



We stat* 
1981a 



DEFINITION OF 
PLACEMENT v 

Employed 30 days 
after leaving the 
program 

Worked at least 1 
week in the 3 months 
after leaving the 
program 



Employed at program 
termination 



Employed at program 
termination 



EMPLOYMENT AND 
TRAINING PROGRAM 

Pre-CETA programs 
in area of Lansing, 
Michigan 

Four pre-CETA pro- 
grams in 10 major 
urban areas 



3 



January-June 1975 
CETA participants: 
Continuous Longi- 
tudinal Manpower 
Survey 

FY 1976 CETA par- 
ticipants : Contin- 
uous Longitudinal 
Manpower Survey 



COMPARISON GROUP 

Attended briefly 
or not at all 



Eligible nonappli- 
cants matched for 
age, race, city, 
and neighborhood 

None j multiple 
regression used to 
produce earnings 
estimates 



Matched groups 
from Current 
Population Survey 



RELATION TO 
EARNINGS GAINS 

Poor 



Poor 



Strong positive 



Strong positive 



^ On the negative side, the 19 post-program proxy yari- . 
ables studied proved to be questionable or poor indi- 
cators of the long-run effects of manpower programs. 
. Apparently the participants* situations 30 and 90 days 
after leaving a program are not reflective of long-run 
program impact. Possibly that is not enough of a time 
lapse after the programs for, the long-run effects to 
take hold. (Borus, 1978, p. 13) 
• » , . 

In view of DOL's use of placement rates to monitor prime 
sponsor performance, Borus judged it especially serious that Ms 
analysis showed no statistically significant relationship between 
the variable of having a job 30 days after the program and four 
of the long-term measures of effect and only a weak relationship 
to earnings. His results, however, must be viewed with an eye to 
the adequacy of the calculations of the long-term net effects and 
the study's limited geographical scope.. The comparison group 
used makes it likely that calculations of net effects were based 
on data from nonequivalent groups. . Nonequivalence of groups is a 
problem in any nonexperimental evaluation, but in this study it 
was especially problematic. People who-do not participate or 
participate only briefly in CETA services may differ from CETA 
participants in many ways, some of them (attitudinal , motiva- _ 
tional, immediacy of need for employment) -unmeasured. Regression 
techniques can correct for differences between groups only to the 
extent that measures of the differences exist and are relatively 
free of error. 



In 1980, a second attempt by Gay and Borus to validate short- 
term performance indicators rectified many of the problems of 
Borus' earlier study. The participant sample consisted of ran- 
domly selected people who had entered four different employment < 
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?Sfi« £S t 9 P fnfe amS ln 10 major urban areas, between December 
1968^nd Ju* e 1970. - The comparison group consisted of eligible 
•nonapplicants matched for age, race, city, and/^en possible 

S2S^' d# ef f 6CtS f ° r em P lovme ^ and ira^n^"^^ 

participation were calculated on the basis of 1973 \social 
Security earnings records. 

• J 

^ ^Defining "placement" as "having worked at least one week in 
the three-month period following program termination" aVc^n- 
on ?S£iS?*; eVen / dditional outcome measures from interview data 
recrre^sld th e a ?on° n r year f° StPr ° gram ex P e riences, Gay and Borus 
• lit JfliJ the long-term net earnings effects of participation on 
the eight performance indicators. 1/ Again, the findings were 
til C lZrl^l P arti ^larly with respect to the predictive power of 

Sdicato^ Tr"^^' WMCh WaS ° ne ° f the Purest performance 
indicators. It was "not significantly related to long-term net • 
earnings gains for any ,dj£ the program or client groups. 

None of the eight performance indicators distinguished them- 
S™I. a - g °° d v prOX y y«iables for long-term earningl gains, but 

225 ! ? W6 f S ^ ^ the lab0r ' f ° rce per garter, changes in 
weeks employed per quarter, and changes in wage rates for the 
longest reported job correlated much more consistently with earn- 
"pi 2 S ' tha ? P lacement s^tus. Gay and Borus recommended - 

f^cement-rate indicators should be discarded as perfor- 
n a n^ i= dlC ? tors 1 lf earnings-gains for participants is the domi- 
l£o 9 D « 6 T P ?^ £ nd traini ^ Programs." (Gay and' Borus, 
1980, p. 43) It should be kept in mind when considering their 

SrJL^f ^J 1 ; def ! nition of placement was different from that 
currently used by prime sponsors— that is, placed in employment 
upon termination from CETA. employment 

Another study in 1980, by Finifter, used data from the Con- 

^?rr?TA° nglt ? dinal Man P° w ^ Survey's sample of January-Sune 
1975 CETA enrollees to investigate the usefulness of the place- 
™ J i able . as a P^dictor of postprogram earnings paths.' There! 
! t °= prison group in this research. Instead, Finifter used !< 
multiple regression estimation methods to produce earnings esti- 
?Jhor ^rolled f or various factors (socioeconomic, preprogram 
K?° r ? e e p erience ' inpfogram experiences, and time-?elated 
Snin J 6 ! strong, positive, and persistent relation Was 

n f si nnn W "\ ^ P^cement variable and earnings paths (upward 
of p ,000 or higher for most subgroups of service type by gender) 
Finifter cautioned, however, that these differences may be the * 
result of multiple factors, that the results are based only on 
participants, artf that the relation is clearly complex. 

1/The seven other performance indicators were change in ( 1 ) number 
of weeks not in the labor force, (2) -number of weeks employed, 
fill Wag r ra c 6 ° n lon S est job, (4) average number of hours worked 



per week, (.5) quarterly earnings, (6) amount of unemployment 
insurance received; and (7)-amount of p^jkic assistance recei 
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'In the fourth such study, in 1981/ Westat, Inc., used the 
Continuous Longitudinal Manpower Survey sample of fiscal year 
1976 participants in CETA adult services, drawing match groups 
from the Current Population Survey to explore differences in pro- 
gram effects on 1977 earnings for terminees placed and not placed 
(or of unknown status). Overall, Westat estimated that the peo- 
ple reported as placed at the time of exit from the program had 
net earnings gains from CETA approximately $1,500 greater than 
those of the people not placed or whose status was not known. 
According to this analysis, the superiority of placed terminees 
held for the -four service types we discuss— classroom training, 
on-the-job training, work experience, and public' service employ- 
ment — as well as for multiple services. 

Interpreting the Westat findings requires looking for pre- 
CETA differences in the characteristics of the groups of CETA 
terWnees placed or not placed (or status unknown), especially - 
preexisting differences that might be associated with employabil- 
ity. In an effort to explore the extent of selection bias asso- 
ciated with the placement variable, Westat performed a discrimi- 
nant analysis to classify participants as placed or not placed on 
the basis of their other measured characteristics. Westat con- 
cluded that "To the extent that discrimination was observed, it 
could have happened 21 times out of- 100 due to random factors. 
(Westat, 1981a, p. 3-40) If the goal of this analysis had been 
prediction', this would not be a satisfactory outcome. Since the 
goal was to explore the existence of selection bias, using less 
stringent statistical criteria was appropriate. Because some 
level of discrimination was possible and because differences 
between people placed and not placed (or of unknown status) 
existed on such measures *s educational level, preprogram earn- 
ings, age, and \ead of family, it is unclear how much of the 
effect Westat attributed to placement status is pure and how 
much is a product of other factors . 

It is not possible to explain with any* certainty the con- 
flicting findings among these four studies on the association 
between short-term indicators of program performance and long- 
term estimates of program effectiveness. In the case of posi- 
tive findings, Geraci and King have hypothesized that the place- 
ment variable reflects participant characteristics as much as it 
reflects program participation influences. (Geraci and King, 
1980) Another hypothesis is that placement is a good predictor 
of long-term positive outcomes when programs have imparted new 
skills to their enrollees. In the absence of a relationship, 
or in the case of negative findings, it may be that sustained 
job search activity after leaving CETA results ^n, fetter employ- 
m'ent opportunities for terminees than taking th^ fir^t available 
job after leaving the program.* Variation - in the quali^of jobs 
within the placement category may also weaken the relation 
between the placement variable and long-term measures that are 
more reflective of. job quality, such as earnings or employment 
stability. -\ 
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between !w! 1*1 a PP roach es may find a stronger relation 
between short-term outcome measures and long-term net effects 
♦It is our opinion that relying in the meanwhile sollly on place- 
^nLr teS tC \r nit0r Pr ° gram P^fc-rmance is inadvisable^ 
till CETA^.r lluStra J^ ^ one study finding that 41 percent^ 
ielvina L " ^L*" em P lo ^ ent status three month's after 

leaving the program different from the status thev had at th P li m * 
\ ?* germination. (Westat, 1979a, p. 5-2) AddiUoLny, foculi^ 
heavily on placement rates may distort future program operation? 

^ tl "! 1 S" that / re n0t c °n3istent P wi?h program objec- 

tives. Although placement data may acquire added value when thev 

we arrreiuct^t'tf ° ther tyP6S ° f f ° lloWU P ^ZtlTj, 
cator of irSor^m % P lacement rate s in isolation as an indi- 

5 rogram Performance. Therefore,, we present only a brief 
summary of national program termination data for CETA. 

ASSESSING ABSOLUTE EFFECTIVENES S — WOIIT.n <S \ 

BENEFITS BE REALIZED WITHOUT THE PROGR AM? V 

l\ - 

T , ro „ r f Valuating the effectiveness of employment and training \ 

5££ To con?raIt a th C ° mPOnentS reqUir6S * ™P«i"°n base agaj^st 
' The valid??S J \ 5 ' ex P eriences ^ of the program participants. 
The validity of studies that consider only the postproaram exoe- 

wJtnout r Whet 5% r Sh0rt ? term or long-t*rm) y of CE?A terminees? ? 
o^ rL 9 t0 P artlci P ant «' preprogram experiences or %ith- ' 
out a comparison group, is threatened In many ways, and their' 

ItZ l S bS quitS ^l^g- Therefore, we Lie omitted 

them from our report. ✓ ( . ° ltte " 

When ^he evaluation question i£ one about absolute effec- 
tiveness the comparison base must permit estimates of what pro- 
gram participants' experiences would have been in the program 's ' 
absence A number of strategies have been used for providing 
such estimates, including true experiments, preprogram and post - 
program comparisons, and naturally occurring^/consSuc^ed^m- 
parison groups True experiments, which randomly assign appU- ■ 

tests If ^r^ 0n ^ 0f / eCeipt ° f ser H ces ' P^vide the s??ongest 
tests of program effectiveness, but no^true experiments have Spph 
used m evaluating the CETA titles discussed iS tMs report 

Comparing the status of people before particioatinr, in * 
program with their status after a program i J J fairly - 

common strategy in CETA evaluation studies. In such studies the ' 
base is the preprogram experience of the enrollees? Some of'tne 

marf^tf 6 eXe ^ ted rather simply, presenting descriptive Num- 
mary data on each variable for both of the time periods and then 
calculating the gross change, others apply' more sophisticated 
techniques, usually multiple regress^n,atteSpting P to con?r"ot 

cSLaSer?l"cs ln fabor CeS T^ h 38 ? a Acipan/socLd^grapSc 
tio^o^program'o^ experience, and. economic condL " 

before^nd^fter ILTrltrtTlV ' J" P artici P a ^s • experience^' 
ana arter the program is interesting for descr^ptive^pur- 
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poses and perhaps also for managerial purposes. Finding, for < 
example, gross losses in earnings in most program components, and 
foremost subgroups of terminees would likely serve as a manage- 
ment warning. Sueh data should not necessarily be- interpreted 
as reflecting program ineffectiveness, however. Extraneous 
events such as those that alte* the local labor market conditions 
may occur simultaneously with program participation, and their 
influence may be indistinguishable from the effects of the pro- 
gram. It is also clear that postprogram outcomes that are good 
cannot be attributed to the program. Only if postprogram out- 
comes are extremely poor can we draw conclusions about program 
performance, and even then our conclusion must be limited to a 
statement that whatever the size of iiny gains achieved from pro- 
gram participation, they were not large enough to satisfy the 
program's objectives. 

Direct comparisons of CETA enrollee status before and after 
participation can be distorted by taking data from the period 
immediately before CETA enrollment as the comparison base. 
CETA's eligibility requirements specify economic disadvantage as 
a condition for receipt of -^rvices. This means that many people 
who participate in CETA are at low points in employment and earn- 
ings immediately before they enter the program (this is commonly 
called "preprogram dip"). If this period is used as the time 

frame for the collection of baseline data, changes in earnings, 

for example, may be inflated. 1/ , - 

Some investigators have used multivariate analysis tech- 
niques in evaluating employment and training programs in order 
to control forf>£kprogram factors (socioeconomic and labor force 
experience variabfL ) that are likely to be associated with the 
postprogram outcomes o> pre-post changes . One has commented that 



Another alternative is to try to predict the expected 
before-to-after change through tlje use of multiple re- 
gression analysis. This procedure uses such mdepend- , 
ent variables as age to cover maturation, and growth 
in the economy to try to account for the problem of 
intervening events. The assumption is then made that 
the predicted earnings of the individual resulting from 
the program are net of these influences. This method, 
however, will not handle the regression toward the mean 
problem. Furthermore, it is very difficult to arrive 
at a regression model which accurately specifies the 
relationships of such variables as earnings and employ- 
ment with explanatory variable's. Studies using cross- 



1/An example of this phenomenon can be seen in Westat s Fol low-Up 
" ReportJjOw3 (1981c). Gross changes in average earnings for 
1975 CETMparticipants were found to vary by as much as $1,600, 
depending on whether preprogram data were drawn from the quar- 
ter immediately preceding enrollment or from four quarters 
Receding. ^ 
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sectipnal data which explain 20-30 percent of the 
variation in earnings or employment are considered to % 
be quite good. This leaves at least 70 perceht of the 

Fin™ S2F I/ 06 "* (B ° rUS ' 19?9 ' ^ 39? 866 ^ 1S ° 

assessini U ?ii°2% Wi ? COmparis r on -9 rou P s »»e a different base for 
assessing the effectiveness of employment and training proarams 

S^Lf° ntra fi - he P° st P^r^ experiences of participant 
n™2™ in J ir ex P^ lences over a time period that inclu«L^ 
program participation) with the experiences of a similar bfifnon- 

ESSiS * IZ 9 % r ~? ° f people ' ^ ma ^ or Problem with this 

ctenlSy simnafffSi^ °5 ■ identif ^ a of people suffi- 

SinQ similar to the Participants to permit reasonable compari- 

^ves^iaa^r^S 9 ™ em J lovme f and earnings experiences. Some 
i™« i 9 ! °f 8 haVe US6d P e °P le wn ° ^ve been accepted into pro- 
?o f^^* attendin 9 them or attended them only briefly 

to form a comparison group. This approach has the advantage of 
insuring "that the comparison group is constituted of people who 

SliJ 12£f f° r Pr ° gram and that ' at Wa8t at ^ time of 
2S?p2S P i" T 2?' W6re motlvated to apply for services. This 
til 5?S WP robl ematic, however, in that- the comparison group 
may differ from the participants in a variety of waVs, some of 
Sif? may 1 be characteristics associated^ith the livelihood of 
later employment and self -suf f iciency^fnd some of which may be 
unmeasured. We discussed this earlier in connection witHhe 

fir IxttlZl ^ h6r analySt has . said ^at "m^ one underad justs 
tor existing pretrammg group differences,^ residual differ- 
ence will be mistakenly interpreted as a -treatment effect." (Di- 
rector, 1979, p. 1-92) We outline some of the selection bias fac- 
tors relevant to this issue later in this chapter. 

The major ongoing Department of Labor evaluation of CETA 
oon.^f s + . com P arison groups for samples of CETA participants and 
contrasts their experiences over years subsequent to CETA enroll- 
ment. People surveyed in the Current Population Survey were se- 
lected through an elaborate matching and disqualification process 
o? rSSi 9 com P ar i son group for estimating the net effects 

(Lsllt pa ^| c ;P a ^on discussed in a later chapter of our report, 
twestat, 1981a) As with any constructed comparison group, the 
accuracy and reliability of the estimates obtained from ?he 
analysis reflect the degree of equivalence obtained for the two ' 

1/" Regression to the mean" is a phenomenon of the statistical 

analysis of t£e behavior of people over time. People who occupy 
the extremes of a distribution at one measuring time tend, to be 

, found closer to its middle (the mean) at subsequent measuring 
times. Since people who enter employment and training programs 
ll B £ yP i Cally : at the bottom of tlie labor force ' some change for 
because S HT* th * ir P artici P at i°n is to be expected simply 
because of this measurement artifact, but such change is unfor- 

pa^ticipat° metlmeS miStaken for cnan 9 e resulting from program 
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groups and the adequacy of the statistical analyses used to ad- 
just for remaining differences. As with the other strategies, 
this one too contains the problem that many factors related to 
employment and- earnings experiences may be unmeasured or meas- 
ured with error: 

A: 

The more pretraining differences one is able to adjust 
away the smaller will be the remaining underad justment 
bias. The bias will not disappear , however, because 
some relevant independent Variables may still be^ omitted 
and because Jthe included variables contain error compo- 
nents.. It should be noted that even variables such as 
race, sex, and age cont/ain error components when used- 
in this context. Such variables are included in the^ 
model because they are important though imperfect 
proxies for posttraining earnings potential. Because 
' they are only proxies they ^will sometimes be over- 
estimates and sometimes underestimates' of an individ- 
ual 1 s true earnings potential. (Director, 1979, p. 198) ^ 

If they are executed well, strategies such as this "can produce 
reasonable approximations to the "true" net effects of employ- 
ment and training programs. If poorly executed, they result in 
biases of unknown direction and size. ,> . 

ASSESSING RELATIVE EFFECTIVENESS — 
WHICH SERVICES WORE BEST? 

In their simplest form, relative effectiveness evaluation 
studies ask the question "Which services work best?" They com^ 
pare immediate outcomes,* long-term outcomes, changes before and v 
after participation, and net earnings impacts for participants 
in two or more employment and training programs or service com- 
ponents. The relative effectiveness question may be further 
refined so that it asks "Which srejrvices work best jfor which sub- 
groups of people?" Answers are especially valuat^'e for CE^A in 
the guidance they can give for selecting the best mix of services 
locally and for specifying allowable activities nationally. 

Obtaining meaningful answers to relative effectiveness ques- 
tions is not necessarily without problems, however. Before any- 
thing else, we need to be ^able to classify individuals accurately 
by type (nature and amount^Df services they received. As \^e 
mentioned earlier, the djfc^io^tions between adult CETA service 
types are not always cleaHM^r^ when contrast s. are made between 
participant outcomes for different service types, selection bi- 
ases may result in nonequiv^lences between groups. Participants 
in a work experience component, for example, may be placed there 
because intake staff judge them to have low employment potential, 
while participants in on-the-job training may he \o assigned pre-r 
cisely because they are thoudht to be ready for jo\s . Direct conN- 
parisons of outcomes fcr these service types are likely to mislead 
us if the employment potential of 1:he enrollees varied across 
service types before CETA. \ 2 

\ 
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Statistical attempts to adjust program outcome estimates for 
nonequivalences are hampered, as we noted that absolute effec- 
tiveness evaluations are, by the difficulty in specifying ^a model 
with explanatory variables that will account for substantial 
amounts of variance in the outcome measures. This difficulty 
ls^increased further when such things as "length of the waiting 
lists" determine the type of service received. Measures of such 
fetors are not likely^ to be available. 

Besides not knowing all we might about the selection process 
and the problems in modeling it, we are hindered in answering 
relative effectiveness questions by the fact that different serv- 
ice types, may train people for different kinds of occupations. 
Evaluations in the employment and training area have not typi- 
cally included this factor in their analyses. Instead, they have 
made direct contrasts between, classroom training, on-the-job 
training, work experience, an/i public service employment without 
attempting to ascertain how much of the differences in earnings 
stem from the area of occupational training (for example, wee- 
ing compared to typing) rather than from the way the training^ 
service is delivered. Considering service types globally, view- 
ing the distribution of occupational training areas within each 
service type as an inherent part of the service, has frequently 
been a way of sidestepping this problem, 



Even when there are fairly reliabl/ national findings that 
one service type is more ^effective than / another , this , information 
still may not serve as a reasonable guide for determining the 
service mix most feasible and , appropriate for a specific locality. 
A locality whose employers are reluctant to make on-the-job 
training commitments, for example, may not .readily be able to ' 
expand this" training activity, even if there is evidence of its 
superiority. 




Where no comparison groups are used or where models specify- 
ing labor force experience and earnings are inadequate for drawing 
conclusions about the absolute effectiveness of the service types, 
the information gap is awkward. Statements about the relative 
effectiveness of two service types may be possible, but it -will 
not be knfcwn whether either service is better than no service. 
A recommendation to continue the better of the two might merely 
be a recommendation to continue with the better of two ineffective 
service types. ■ ^ 

SELECTION BIASES IN EVALUATION S TUDIES— ' J 

WHAT ARE THEY FOR CETA? ' ' 

We have referred to several kinds of selection bias through- 
out this chapter. Sources of selection bias may be associated 
with individual decisions to participate in CETA, with decisions 
of prime sponsors to provide services, and with employers' deci- 

™?f, 5° hirS ^ nd retain individuals. Exhibit 4 lists some com- 
monly discussed sources of bias. 
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Exhibit 4 

Sources of Selection Bias in Evaluations 
of Employment and Training Froorans 



PRIME SPONSOR 

Availability of services 
Whether or not various types 
are a va i lable' local 1 y 

Targeting of services 
To the most employable 
To the most disadvantaged 

Assessment of participants 
Matching applicants' assessed 
needs to fcFTA services' 



EMPLOYER 

Need for employees * 
Additional employees 
Employees with specific skills 

Attitude 

toward CFTA participants 
Toward people with various 
sociodemographi.c charac- 
teristics 



PARTICIPANT 
Motivation 

To ent£r or not enter the 

labor market 
To apply or not apply for 

CETA services 
To accept or reject services 
Immediacy and degree of need 

for work 

Human capita 1 

Education, skill, and general 



abil ity 



ienc 



Work experience 

Sociodemographic and economic 
characteristics 
Age, race, and gender 
Urba-n or rural residence 
Employment status and earnings 
history 



TWO-PARTY DECISIONS 

Prime sponsor ; to offer or 
not offer services / 

Participant : to accept or 
reject sponsor's offer 



Employer ; to offer or not 

offer employment 
Participant ; to accept or 
reject an employment offer 

Employer and employee ; to 
continue or terminate, the 
reiati onshi p 



Models used in evaluations of employment and training pro- 
grants often cannot correct for more than a few of these factors.. 
They try to include proxy variables to substitute for what is not 
directly measurable. For example, status as the head of house- 
hold in a fawrffi^of two or more members might be used to substi- 
tute 'for a^need to earn" motivation. To the extent that these 
f Actors distinguish CETA participants from nonparticipants >or 
distinguish among participants receiving different types of CETA 
iervices, and to the extent that these factors cannot be con- 
trolled for statistically, biases will remain. Exhibit 4 should 
be kept in mind as the reader interprets the estimates of program 
effects we review in this report. % 
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SUMMA RY 

' • » 

P 

In considering various bases for evaluating CETA adult serv- 
ices, we have presented information on proposed benefits from em- 
pl6yment and training programs, assessed the appropriateness of 
these benefits as evaluation criteria, reviewed studies on the 
validity of placement rates as a short-term performance indicator, 
and outlined the strengths and weaknesses of several evaluation 
'approaches. Prom this, we call attention to the following issues: 

— A large number of potential benefits have been proposed 
for emf^yment and training programs. Therefore, CETA 
cou^^B^evaluated against a range of economic and non- 
economic criteria. However, earnings gains, the legis- 
" lativevobjfective of CETA, are a reasonable proxy for 
many of thesg proposed criteria and have been used' the * 
most frequently. 

— The four types of adult services we covered in this 
review have somewhat different objectives and are 
^ designed to fulfill different needs of the unemployed 
v • population. As a consequence, it is likely that some 
services have enrollees who are less disadvantaged 
than others. On-the-job -training, for example, may 
be expected to have enrollees who are less disadvan- 
taged than work experience, as a function of on-the- 
job training's focus on people who are ready for jobs 
and capable* of acquiring skills in an actual work set- 
ting, if, as we believe, these differences in th£ 
characteristics of enrollees exist, and if other dif- 
ferences in wi thin-program opportunities for contact 
^with potential employers and occupational areas of 
training and;. employment also exist, we can expect 
laftyer- earnings gains for classroom training and on- 
the-job training than for work experience. Addi- 
tionally, although earnings gains seems an appropri- 
ate criterion for assessing the' effectiveness of 
employability development services such as on-the- 
job graining , classroom training, work experience, 
and counterstructural PSE, it 4 is less "appropriate / 
for evaluatingx the countercyclical PSE proqram of 
title VI. , 

» ' % * * > 

-The conflicting results of validation studies on 
placement rates as predictors, of long-term program 
effectiveness, and other ambiguities -associated 
with their use 'even in the short term, persuade 
us against using placement rates as the ihajor ,or 
solitary ^program performance indicator. 

-Assessing the absolute and relative, effectiveness ' 
of . adult services requires a "comparison base, 'in 
discussing study designs relevant* 'to information 
presented in this report, we note that- pre-post 

^ '-v * * * • 
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program data can be used only for descriptive pur- 
poses; it is not legitimate to use such data for 
assessing program impacts. Studies using compari- 
son groups are generally more appropriate for as- 
sessing program impacts, but they also can have^ 
limitations. Common problems include inappropriate 
comparison groups and data or analysis strategies 
inadequate for adjusting for preexisting differ- 
ences between program participants and comparison 
group members. As a consequence, employment and 
training evaluation studies serve mainly as back- 
ground information for informed decisionmaking 
rather than providing firm answers. 
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CETA PARTICIPANTS, THE SERVICES 

AND BENEFITS THEY RECEIVED, 
AND THEIR STATUS AT TERMINATION 



In this chapter, we describe the implementation of the CETA 
Corfiprehensive Services and PSE titles with respect to the char- 
acteristics of the enrollees and the types of services and bene- 
fits they fe^ceived. ,we also present data on the employment' 
status of the participants at' the time they left CETA. in com- 
bination with the information on the nature of the enrollees 1 
occupational exposure, presented in the first part of the chap- 
ter, these data help us understand the implementation of CETA 
adult services and interpret the information on outcomes and 
effectiveness that we present in chapters 5 and 6. 

THE CHARACTERISTICS 
OF THE PARTICIPANTS 

t 

Prime sponsor^ are required to report data on participant 
characteristics to DOL for all CETA titles under their authority. 
Table 3 arrays participant characteristics data for the Compre- 
hensive Services titles ClIB-C) and the PSE titles (IID and VI) 
for fiscal years 1975, 1977, and 1979. 

As the table shows, the great majority of participants in 
these three titles were unemployed at the time they enrolled in 
CETA. Sixty- two percent of entrants were unemployed- upon enroll- 
ment in the Comprehensive Services title in fiscal year 1975; 
as many as 91 percent were unemployed upon enrollment in PSe' 
title VI in fiscal year 1979. The percentage of AFDC recipients 
was highest for the Comprehensive Services title in all three 
years, ranging from 16 to 18 percent, while AFDC recipients in 
the PSE titles fluctuated between 6 and 13 percent. The* oppo- 
site pattern obtained foA Unemployment Insurance — here the per- 
centage of recipients ranged from 11 to 16 forvthe Public Service 
Employment" titles but never exceeded 7 for the Comprehensive 
Services title. 



I CETA's definition of "economically disadvantaged" shifted 

in the period 1975-79. In fiscal years 1975 and 1977, -It was 
based on the poverty level as defined by the Office of Manage- 
ment and Budget; in fiscal 1979-, it was based on whichever was 
the higher, the OMB poverty level or 70 percent of the lower 
living standard income level as defined by the Bureau of Labor 
Statistics. The use of a higher income standard afte^r 1978 
renders comparisons across years problematic. 

To assess accurately the changes in the proportion of 
economically disadvantaged who were served requires a standard 
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Tafele 3 

Characteristics of Participants in Comprehensive Services and Public Service 
Employment Titles for Selected Fiscal Years (in Percent) 



C 



Comprehensive Services 

Title IIB-C 

1975 1977 1979 



Title IIP 
1975 1977 1979" 



Public Service Employment 



Title VI 



1975 1977 



Male 


54 


52 


47 


Ppma 1 p 


46 


48 


53 


Aa e in vear s 






48 


21 and younger 


62 


52 


22-44 


32 


41 


45 


45 and older 


6 


8 


7 


Years of school 








8 or fewer 


13 


10 




9-11 


48 


40 


19 


12+ 


39 


50 


52 


High school dropout 








Aid to Fajft^lies with 


16 


16 


18 


Dependent Children 


11 


10 




Public assistance 


8 


Economically 






90/71 


disadvantaged a/ 


77 


78 


Race/ethnic grotfp 








White 


55 


57 


51 


Black 


39 


3 5 


J J 


Hispanic 






13 


Other , 


* 6 


8 


3 


Spanish speaking (est. 


) 13 


14 




Limited English 


4 


5 


5 


Migrant or seasonal 


2 


2 


1 


farm family member 








Veteran 






9 


Recently separated 


INA 


4 




Special c/ 


h 


3 


1 


Vietnam 3/ 
Other 


4 


c; 


4 
1 


Handicapped 


4 


4 


7 


Offender 


6 


7 


8 


Labor force status 








Unemployed 


62 


74 


77 


Underemployed 


5 


5 


4 


Other e/ 


33 


21 


19 


Receiving Unemploy- 








ment Insurance 


4 


7 


5 



66 
34 



24 
63 
13 



10 
18 
72 



7 
9 
48 

65 
22 

13 

16 



INA 

I" 

13 
3 
3 

84 



12 



60 
40 



20 
64 
16 



7 
.15 
78 



71 

23 



14 

3 



5 
7 
10 



3 
3 

\ 

21 
15 



52 
48 



2 
72 
6 



13 



49 86/68 b/ 



55 
29 
13 
3 



5 
1 

16 

3 
6 
1 

5 

5 



82 
2 
16 



11 



70 
30 



18 
74 



6 
8 
44 



71 

23 



13 
5 



I" 

15 
3 
3 



88 
6 
6 



15 



1979 



64 

36 



8 
19 
73 



66 
26 



12 
3 



7 
7 

12 

4 

4 



81 
3 
16 



16 



57 
43 



23 


21 


20 


22 


63 


65 


.6 5 


63 


15 


14 


15 


15 



2 
71 
27 




54 
30 
12 
3 



4 
1 

17 

3 
6 
1 

5 

5 



91 
2 
7 



12 



Source: Adapted from National Commission for Employment Policy, Sixth Annual Report to 
the President and the Congress (Washington, D.C., December 1980), pp. 112-13. 



a/Before 1978, "economically disadvantaged" was defined by the applicants being a member 

" of a family whose annual income in relation to family size and location did not exceed 
the poverty level as defined by OMB. Today the determination is based on the poverty 
level or 70 percent of the lower living standard income level of the Bureau of Labor 
Statistics, whichever is higher. 

b/The second number is the proportion of people who met only the OMB poverty criteria. 

c/Served in Indochinese or Korean theater of operat ions between August 1964 and May 1975. 

3/Served between August 5, 1964, and May 7, 1975, and is younger than 35 years. 

e/Employed or not in the labor force. 




t 



criterion — the OMB poverty level — shown as the righthand figures 
in the 1979 columns in table 3. Comparing these 1979 figures 
with the figures for the economically disadvantaged in 1975 and 
1977, we can see increases in the proportion of economically 
disadvantaged people who were served in both of the PSE titles , 
from fiscal 1975 to fiscal 1979. These increases reflect the 
fact that CETA's eligibility requirements for PSE were changed 
to include an income test. The eligibility requirements of the 
Comprehensive Services title were also tightened during this 
period, but little change is evident in the proportion of eco- 
nomically disadvantaged people who were served. However, since 
77 percent of the Comprehensive Services enrollees were economi- 
cally disadvantaged in 1975, there was less room for improving 
the targeting for this title than for PSE. 

While it is not possible to determine from the prime sponsor 
reports the percentage of enrollees who were high school dropouts 
in CETA's early years, the data for fiscal 1979 indicate that 
some 26 to 29 percent of enrollees were dropouts and could be 
categorized as educationally disadvantaged. 

The proportion of females was higher for the Comprehensive 
Services title than for the PSE titles. In fiscal 1975, the 
ratio of males to females for PSE title VI was 70:30. By 'fiscal 
1979, this had shifted to 57:43. A comparable shift— from 66:34 
to 52:48 — occurred for title IID. The Comprehensive Services 
title enrolled slightly more women than men in fiscal 1979. It 
also had a percentage of youth enrollments twice- that of either 
PSE title for all three years. 

These differences in enrollee profiles for the Comprehensive 
Services and PSE titles on such variables as economic disadvan- 
tage, gender, and age lead us to expect employment and earnings 
outcomes to be less positive for tb€ Comprehensive Services title 
than for the PSE titles. This is Especially true for enrollees 
in Comprehensive Services in-schoor youth programs, which do not 
have employment as an immediate objective. In sum, these global 
data lead us to make a general depiction of participant^ in 
these CETA titles — especially participants in the Comprehensive 
Services title — as relatively disadvantaged with respect to 
employability . 

This picture is reinforced by data fron/the Continuous 
Longitudinal Manpower Survey. (CLMS) on the preprogram labor force 
experiences of enrollees in^CETA adult services. Here the data 
are aggregated across adult service types rather than broken down 
by title. As we see in table 4, approximately one-third of the _y 
enrollees in fiscal years 1976, 1977, and 1^78 were unemployed 
50 percent or more of the year preceding their entrance ihto 
CETA. Another one-fourth to one-third were out of the labor 
force at least half of that year. Depending on the year, Qgly 
some 9 to 14 percent were employed for 90 percent or more cn: the 
preprogram year. 
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Table 4 



Pre-enrollment Labor Force Experiences of People Enrolled 
in CETA Adult Services Titles IIB-C, IID, and VI 
in Fiscal Years 1976-78 (in Percent) a/ 



1Q76 1977 1 Q 78 



Predominantly employed b/ 7 


14 


10 


Q 


♦ 


Predominantly unemployed c/ 




38 


32 




Not in labor force d/ 


27 • 


27 


31 




Residual e/ 


27 


24 


2P 





Source: Westat, Inc., Continuous Longitudinal Manpower Survey , 

Report No» 8 (Washington, D.C.: U.S. Department of ^ 
Labor, March 1 Q 79), table 23 and p. Sri?, and Contin - 
uous Longitudinal Manpower Survey, Report No. 10 (Wash- 
ington, D.C.: U.S. D epa rtment of Labor, October 1980), 
table 3, * 

a/Fiscal year 1976 begins July 1? fiscal years 1977 and 197fl 
" begin October 1 . 

b/Employed during 90 percent or more of the year before enroll- 
"~ ment in CFT» . 

c/Out of work and looking for work for SO percent or more of the 

year. ^ 
d/Out of the labor force during 50 percent or more of the year. 
e/Experience fits none of the other categories. 

The percentage of high school dropouts in the fiscal 1977 
and 1978 CLMS samples varied between 28 and 29, while the median 
family income for enrol lees in adult services was less than $6,000 
for all three fiscal years .1976, 1977, and 1980. (Westat, 1979b, 
1980) To place this latter figure ii£ perspective, we should con- 
sider that the median family size of CETA enrol lees was 3.5 mem- 
bers in fiscal 1977 and the lower living standard budget for a 
family of four, as established by BLS, was $10>041 in the fall 
of 1976 ($10,481 the next year). In the aggregate, CETA partici- 
pants appear to have been disadvantaged economically, education- 
ally, and'with regard to employment stability, 

THE NATURE OF THE SERVICES THEY REC 

Under the Comprehensive Services title, several different 
types of service can be provided. \ For the most part, the mix 
is determined locally by prime sponsors. The PSE titles subsi- 
dize public service jobs, by definition. Limited information on 
the nature of services under these titles is available through 
DOL's prime sponsor reports and CLMS. o 

Table 5 on the next page presents information from DOL'6 
prime sponsor reporting system on participants in the four major 
^services in title IIB-C, the Comprehensive Services title. These 
are classroom training, on-the-job training, work experience, and 
public service employment. The table' shows that classroom train- 
ing and work experience together ^presented some 80 to 90 percent 
of this title's enrollments in the mm: types | of service across 
fiscal years 1975-80. This high percefrk^ge, however, masks some 
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Table 5 

Percentage of Individuals Served Through Comprehensive 
Services Title IIB-C by'Service Type 
for Fiscal Years 1975-80 a/ 



Classroom training 

Qn-the-job training 

Work experience 

Public service 
employment 



1975 1976 TQ1976 1977 1978 1979 1980 



25 


28 


30 


35 


40 


43 


48 


8 


11 


11 




18 


16 


13 












< 




63 


56 


55 


48 


41 


' 40 


-39 


4 


5 


5 


3 


2 


1 


less 














than 



Source: U.S. Department of Labor, Employment and Training „ 
Administration. 

a/Fiscal years 1975 and 1976 begin July 1; fiscal year* 1977, * 
1978, 1979, and 1980 begin October 1. TQ 1976, the transi- 
tion quarter July 1 to September 30, 1976, is a bridge be- 
tween 1976 and 1977. Classroom training percentages and 
totals^on which all percentages are based'exclude people 
served by Governor's Vocational Education grants. Percent- 
ages are based on .individuals served through these four 
service types only. 



important changes that were made in the mix of services provided 
over time. 

First of all, public service employment was phased *out as 
an allowable activity under title IIB-C; the decline of PSJ? to 

Table 6 

* 

Distribution of Public Service Jobs by Function, 
Estimates for Fi3cal Years 1976 and 1978 1 
( in Pe rcent) a/ 



Titles I ID aftd VI Title VI 
~"~* Su3tainment Projects 





1976 


1978 


1978 


Law enforcement 


'11 


13 


3 


Education* 


12 


17 


12 


Public works, transportation 


24 


26 


26 


Health , hospitals 


7 


8 


5 


Environmental quality 


.3 


4 


16 


Fire protection 


1 


2 


4 


Parks , recreation 


8 


10 


11 


Social services 


7 


10 


, 14 


Administration, nniscell aneous, 


27 


10 


9 



unknown 



Source: U.S. Department of Labor, Employment and Training 
Administration . 

N I 

a/Fiscal year 1976 begins Juty 1? fiscal year 1978 begins 
October 1 . | 



less/ than 1 percent of th^fiscal 1980 service mix reflects 
this. Second, classroom tracing yas given to only 25 percent 
"6f the participants in f iscal\1975 'but was the predominant serv- 
ice type in 1980, accounting for 48 percent of the service mix- 
Third, work experience declined from 63 percent of enrollees in 
1975 to just below 40 percent in 1980. Finally, on-the-job 
training showed a slight increase, peaking at 18 percent in 1978 
and covering 13 percent of 1980 enrollees. 

Overall, the shift in' service mix from fiscal 1975 to fis- 
cal 1980 was in the direction of providing services designed to 
foster the acquisition of job skills rather than jo£ experience. 
Prime sponsors reduced their investment in work experience activ- 
ity by morfe than 20 percent. Nevertheless, the 39 percent of 
fiscal l98(\enrollees in work experience indicates that this 
service type^remains a major part of , prime sponsors' employment 
and training services. Whether this is a function of an identi- 
fied need for such services or of a lack of resources for deliv- 
ering more skill-oriented services is a question we canpot answer 
at this time. It is, however, a question of some importance , as 
we will note later, since its answer has implications for the 
modification of the present employment and tracing system or 
the development of new strategies . 

In table 6, we see estimates of the distribution of public 
service jobs by?function (guards, teachers' an^ nurses' aides, 
and the like) fdr fiscal 1976 and 1978. The 1978 distribution 
is divided into two port ions — sustainment and projects. The sus- 
tainment column refers to continuing positions under titles IID 
and VI; the projects column refers to positions subject to the 
requirement we discussed in chapter 2 that PSE jqbs be located 
in projects of no more than 12 months duration. The general area 
of employment can be deduced from this table but, unfortunately, 
the type or level of skill necessary to execute jobs cannot. 

The largest proportions of sustainment and projects PSE 
positions were in the public works 'and transportation category, 
the largest being 26 percent. Education accounted for from 12 
to 17 percent of the jobs. Some shifts are noticeable front 1976 
to 1978, and some differences occurred between sustainment and 
project distributions. While 27 percent of PSE positions were 
recordea in the "administration, miscellaneous, and unknown" 
category in fiscal 1976, only about 9 to 10 percent of PSE posi- 
tions were in this category in fiscal 1978. Projects positions 
in fiscal 1978 were less likely to be in the law enforcement and 
education categories than sustainment positions were. and more 
likely to be in the areas of environmental quality and social 
services. * 

Data on the distrrbutioh of PSE jobs are available only for 
fiscal years 1975-78. The general pattern for 1975 is similar to 
that of 1976, and it is the same for the sustainment and the proj- 
ects distribution for 1977 and 1978. The differences between 
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Table 7 



Within-Program Occupational Areas of Service Type 
for Fiscal Vear 1976 (in rercert) 







Tra l n) 






rmnl ovment 




t 


Classroon 


On-the- 


30b 


Ml) 1 M n 1 a 


Adult work 
exper lence 


Publ i c 
service 


Tot a 


Professional or 
technica 1 


7 


5 






r ^ 


14 


10 


Clerical 


30 


15 




37 


24 


?? 


25 


Crafts 


19 


21 




23 


7 


10 


14 


Nontransport 
operatives 


15 


?8 




15 




3 


11 


\onfarm laborers 


1 






2 


1ft 


19 


12 


Service 


17 


n 




IS 


20 


2 1* 


19 


Other 


2 


12 




2 


10 


I 1 


9 


Est. total 
terminees 


67,900 


53, 700 




9,600 


4P.300 


132,000 


311,500 



reporting an 
occupat ion 



Source: westat, inc., Continuous Longitudinal Manpower Survey, Follow-U p Report 

No - Z (Washington, D.C.: V.S. Department of La*or, March 1Q7Q) , p. 3-2 2. 

a/Often includes an employment activity, but at least two-thirds of the combina- 
tions in this category involve classroom trainina. 
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the sustamment and projects distributions in the law enforcement 
and environmental quality categories appear to be consistent with 
the efforts to reduce substitution and displacement by using PSE 
workers for short-term special projects rather than for ongoing 
local government services. 

Additional information on the nature of the wi thin-program 
experiences of participants in adult services under the Compre- 
hensive Services and PSE titles reveals the occupational areas 
associated with service types for fiscal 1976 participants who 
had terminated from CETA within 18 months after enrolling. 1/ 
The data in table 7 are based on postprogram interviews .with 
terminees and refer only to the first type of service partici- 
pants received after enrolling/ (Westat, 1979a, p. 3-21) They 
complement table 6, however, x by providing information on the type 
of skill involved in the training or the job: 

The occupational dj^trl&utions of in-program jobs differ 
very little between the two program activities which 
involve employment. PSE and AWE [adult work experience] 
jobs were concentrated about equally in the clerical 



l/Comparable.-aata for January to June 1975 terminees are also 
available^ (Westat, 1981b); the distributions are very similar 
to those shown in table 7. 
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v and service categories, and secondarily in nonfarm laboring 
occupations. . . . The occupational distribution of the 
first training activity of those in CT, OJT, or in multiple 
activities is fairly distinctive from the employment distri- 
bution, in expected ways. In particular, training in CT and 
in multiple activities was concentrated in clerical occupa- 
) tions. Approximately equal proportions (between 19 percent 
and 23 percent) of CT/ OJT, and multiple activities terminees 
were trained as craftspersons . (Westat, 1979a, p. 3-23) 

The most frequently reported o6cupations in each major occu- 
pational area included the following: clerical (typists 16 
percent, secretaries 17 percent, and teacher aides 8 per- 
cent); service (janitors and charpersons 30 percent, nursing 
aides 12 percent, and guards or watchmen 8 percent); nonfarm 
laborers (gardeners or groundskeepers 35 percent, construc- 
tion laborers 26 percent, and garbage collectors 8 percent); 
crafts (carpenters 9 percent, automobile mechanics and body 
workers 21 percent, and construction or maintenance workers . 
10 percent); professional or technical workers (social work- 
ers 15 percent, recreation workers 10 percent, and personnel ^ 
or labpr relations workers 6 percent);* and operatives (weld- 
ers 21 percent, macWine operators 10 percent). (Westat, 
1979a, p. 3-22) 

It should be noted that the concentration of operative occu- 
pations in the on-the-job training (OJT) service category was 
high compared to other categories. Since welders and machine 
operators constituted a large proportion of the operative occu- 
pations — 21 percent and 10 percent, respectively — and since some 
21 percent of the OJT category consisted of craft occupations, 
OJT services might be -expected to have relatively more positive 
results than other types of CETA services, simply as a function 
of the higher wages typically paid for these kinds of skills. 
Overall, the distributions of occupational areas within service 
types appear to be consistent with the descriptions of service 
types we provided in chapter 3. 

The degree to which these occupational areas remained asso- 
ciated with service types in the later years of CETA is unknown. 
Comparable data for after fiscal 1976 are not available. The 
tighter el igibility requirements imposed since fiscal 1976 may 
have led to changes in the mix of occupational areas within serv- 
ice types. Changes in the occupational mix in the Comprehensive 
Services title are likely to have been less pronounced, reflecting 
the shifts in the mix of classroom and on-the-job training and 
work Experience 'activities that occurred over time. Changes in 
the occupational mix of PSE jobs may have been partially a func- 
tion 'of the imposition of wage restrictions and the requirement, 
to create a portion of PSE jobs in projects of limited duration. 
One study of 23' prime sponsors that were required to reduce the 
average wage for new PSE^participants predicted the following 
ejrfects on the types of jobs and services provided by PSE; 
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in areas where average wages must be lowered, use of PSE 
for high-skill professional, technical, paraprofessional , 
and craft jobs will be reduced. 

Almost all areas that were required to reduce their aver- 
age wages planned to restructure PSE jobs. Restructuring 
will generally involve intermediate-skill paraprofessional 
and clerical occupations, but even low-skill service worker 
and laborer jobs will be redesigned in some areas because 
the prevailing entry tyage for these positions exceeds the 
PSE wage .that can be approved. Professional and craft 
jobs are more likely to be discontinued- than restructured. 

le PSE activities that will most frequently be "cut back 
, are those involving the primary governmental services of 
law enforcement, fire protection, and education. An in- 
creased portion of PSE will support the development and 
maintenance of parks and recreation facilities and will 
require a high proportion of workers in unskilled laboring 
jobs. More PSE positions will be devoted to providing 
social services, largely through nonprofit organizations. 
(Mirengoff, 1980, pp. 100-01) 

PARTICIPANT PROFILES 
AMONG SERVICE TYPES 

One task of prime sponsors is to match the needs and occu-' 
pational interests of enrollees with the available training and 
employment services. This matching process and differences in 
eligibility criteria among the titles result in different char- 
acteristics profiles for participants in the services. In gen- 
eral, CLMS samples of fiscal 1976 adult service enrollees show 
that* classroom training and work experience were given to more 
disadvantaged people than on-the-job training and public service 
employment were. PSE recipients were the least disadvantaged 
of enrollees on a number of dimensions, as table 8 shows. Among 
PSE participants, there were fewer minority enrollees, more high 
school graduates, fewer households below the 0MB poverty level, 
fewer households with family incomes less than $6,000, and fewer 
individuals with incomes less than $1,000. Classroom- training 
was given to the most disadvantaged- of CETA enrollees as assessed- 
by both demographic and income criteria for fiscal 1976; v 36 per^ 
cent of classroom training participants were in families recelv- 
ing at least one form of public benefit, and 37 percent were 
unemployed for 50 percent or more of the year preceding enroll- 
ment in CETA. 

Whereas table 8 gives profiles of enrollees in CETA adult 
services for fiscal 1976 , table 9 on page 48 gives the same 
profiles for fiscal 1978. JTi\a. least disadvantaged, of CETA fen- 
rollees had the .greatest participation in on-the-job training. 
P ^ ticipantS in classr ? om training and work experience appear 
roughly comparable, the differences varying in direction across 
several categoxd.es. 
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Table 8 

Characteristic* of Enrollees in CETA Adult Services 
for Fiscal Yea* 1976 {in Percent) 



Training 



Employment. 



Classroom 


On-the-job 


Adult work 
experience 


Public 
service f 


Female 


50 


35 


48 


34 


Age in years 
21 and younger 
22-29 

30 and older 


36 
40 
24 


33 
40 
26 


lo 

48 
42 


24 
43 
34 


Minority 


55 


38 


40 


31 


High school graduate 


60 


69 


64 


76 


Veteran 


16 


24 


20 


27 


Below 0MB poverty 
level 


66 


52 


61 


44 . 


Family receiving 
oenef its 


36 


20 


26 


16 


Family income less 
than $6,000 


64 


54 


64 


48 


Enrotlee income less 
than $1,000 


56 


43 


48 


38 


Labor force status a/ 
Predominantly employed 
Predominantly unemployed 
Not in labor force 
Residual 


11 
37 
31 
22 


16 
29 
27 
28 


15 
34 
27 
24 


17 
27 
24 
32 



Source: Westat, Inc., Continuous Longitudinal Manpower Survey , 
Report No- 8 (Washington, D,C. : U.S. Department of 
Labor, March 19/9), appendix B, tables 14-17. 

a/These categories are/t employed during 90 percent or more of 
" the i-J months before enrollment in CETA (predominantly em- 
ployed), out of work and looking for work for 50 percent or 
more of that year (predominantly unemployed), out of the labor 
force during 50 percent or more of that year (not in labor 
torce), and experience fits none of these categories (residual). 



In fiscal 1978 f PSE services ft^re given to more disadvantaged 
enrollees than in fiscal 1976 with respect to income and labor 
force status before CETA participation. The revision of PSE el- . 
igibility requitement3 appears to have succeeded in directing 
CETA PSE services more toward the disadvantaged. The overall 
shift in the PSE participant profile comes largely from the 
characteristics of people enrolled in PSE special projects of 
limited duration. Table 10 on the next page shows data on par- 
ticipant characteristics for fiscal 1978 sustainment and project 
enrollees. On most of the comparisons, PSE jobholders in proj- 
ects are relatively more disadvantaged than are \ustainment job 
holders. • 

These differences in participant profiles across service 
types are not utaexpected; they are consistent with our earlier 

4 / 'A 
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Table 9 



Characteristics of Enrollees in CETA Adult Services 
for Fiscal Year 1978 (in Percent) 



Training 



Classroom On -the - 3 ob 



Employment 




Adult work Public 
experience service 



Femal e 

Age in years 
21 and younger 
22-29 

30 and older 
Minority 

High school graduate 
Veteran 

Below OMB* poverty 
level 

Family receiving 
benefits 

Family income less 
than §6,000 ~ 

Enrol lee income less 
than $1,000 



40 
36 
25 

50 

61 

11 

74 

35 

57 

50 



Labor force status a/ 

Predominantly employed 10 

Predominantly unemployed 31 

Not in labor force 30 

Residual 29 



36 

36 
38 
26 

32 

69 

21 

62 

18 

45 

, 35 



17 
24 
25 
34 



56 

49 
51 

42 

70 

18 

77 

36 

62 

54. 



10 
39 
25 
27 



38 

23 
42 
34 

39 

75 

24 

73 

- 26 

56 

44 



8 
40 
22 
31 



Source; Westat, Inc., Continuous Longitudinal Manpower Survey , 
Report No. 10 (Washington, D,C. : U.S. Department of 
Labor, October 1980), appendix B, tables 6-9. 

a/These categories are: employed during 90 percent or more of 
the 12 months before enrollment in CETA (predominantly em- 
ployed), out of work and looking for work for 50 percent or 
more of that year (predominantly unemployed), out of the labor 

\ force during 50 percent or more of that year (not in labor 

force), and experience fits none of these categories (residual). 



Table 10 



Characteristics of Enrollees in Public Service 
bmployment Sustainment and Project Jobs-* 
for Fiscal Year 1978 (in Percent) 



Female 



Sustainment _ Projec t 

38 38 



Age in years 

21 and younger » 03 

22-29 

30 and older 35 



Minority 3^ 
High school graduate 73 



p 23 

41 44 
34 

* 42 

72 

Veteran . 25 23 

Below OMB^ poverty level 68 78 

Family receiving benefits 24 28 

Family income less than $6,000 49 i v, 63 

Enrollee income less than $1,000 39 * 49 

Labor force status a/ 

Predominantly employed 9 7 

Predominantly unemployed 35 ^4 

Not in labor force 22 22 

Residual 35 2 8 



Source: Westat, Inc., Cont 1 n uou s Longi t ud 1 nal Manpowe r 
Survey, Re por t "No .^10 ( Wash" 1 ngton D . C . ; U 7S 7 
Department of Labor, October 1980), appendix B, 
tables 10 and 11. 

a/Jhese categories are: employed during 90 percent or more 
pt the 12 months before enrollment in CETA (predominantly 
employed), out of work and looking for work for 50 percent 
or more of that year (predominantly unemployed), out of 
the labor force during 50 percent or more of that 'year 
(not in labor force), and experience fits none of these 
categories (residual). 



Table XI 

Average Withia-Program' Hourly Wages 
by Service Type a/ 



participant, group " * 
January-June^jl975 FY, 19T% >«, 



» . - On-the-job training §3.06 . , §3.21 

WorK experience • , 2.67 2.68 , 

< f 

Public service employment * 3.25 - 4 ^.24 , , ■ 
♦ ' ; ; * 4 * * 

Source: Weatat, Inci , Continuous J^ngitudinal Manpower 

Survey, Follow-Up Report No. 2 ^Washington, D.C. : 
. U.S. Department of Labor, March 1979), p. 3-17, 
and Continuous* Longitudinal Manpower Survey , , % 

Follow-up Report) ^> 3 (Washington, -P. C. : U.S. % , . 

Department of Labor, Jaftuary 1981), p'. 4-j10. 

• a/Weatat found data on classroom training allowances to be ^ * 

" of questionable validity, and wage rat'e'data are therefore * > 

not available *or the classroom training service. « 

descriptions of service type*/" For example, 9^ en ^ the ,^^Hi° n 
of on-the-job training as,a service type suitable for job- ready . 
'trainable individuals, 'it is not . surprising that the profile o£ 
enrollees in on-the-job training shows them as less disadvantaged 
than others or that the classroom, training and work experience # 
profiles are at the opposite-end of the spectrum. 

■The variation in participant prof lies' has implications for' 
the interpretation of other data in this report. Given tha 
profiles of fiscal 1976 on-rthe-job training and public service 
employment enrollees show them as relatively less ^dvantaged , . 
we should expect better outcomes from', these services" for the 
'1976 cohort, .in other word*, the outcomes of service types^are ■ 
a function of the characteristics of their enrollees and also 
of-the nature of. the. services themselves. ' - * 

WITH IN-PROG RAM* WAG.ES , - „ v ; ^ • 

AND ANCILLARY BENEFITS 

A program that dois^not provide adequate monetary and other 
resources to its enrollefs may be unlikely to retain them long 
JnoSgn ?o realize its economic and social objectives. Unfortu- .. 
•na?ely, information on within-program benefits is pliable only 
for samples of . participants in adult CETA services for January 
to June 1975 and fiscal 1976. 1/ 

As table 11 shows, the average hourly wage.paid fc o partici- 
pants in one-the-job training, public service employment, and work 



1/This information is f <if J.anuary-June 1975 enrollees with at 
" least' s days of CETA experience, but terminated from CETA 
within 36 months Of entry and f or 1976 enrollees terminated. 
"witnin'18 months of entry/. (WeStat, 1979a and" 1981b) 



Table 12 

Average Within-Prograra Annualized Earnings 
by Service Type .a/ 









Participant 
january-june 1975 


group 




✓ 


On-the-job training 


$5,790 


FY 1976 
* $5,500 






Work experience 


4,670 , 


4,170 






Pubfic service employment 

a ' ; 


6,500 ' 


,5,920 



Source : 



T.ltlt' I"?;' Continuou S Longitudinal Manp ower 
"• s ; Department oi Labor, March 1979), p. 3-19 and 
-K l !lT S Lon ! it [ ldinal ManPQWer fi " "ey^ P oUo:-" d 
LXr^anua rrmnrp.'' ^:' o t 

a a h os c ^n:%^r^t a c^3o^r ua io z o ed b t^n nin9s inciuded ai1 

earnings westat divided total" Jpro^ ^4--"?- ^""the 
number of days between tpta »n»-r»!w^ I ^ oy the 

and then nultiplfed^y 365 ent " nCe and termination dates 

January-June 1975 Se SJ?n2?? c ^ a ? sroom training. During 
creased to to In , national minimum wage was $2.10- it in- 

2S.Sence particrpan^rr^ei^ed 976 ,; lW W ^ es ^ ™* 

nualized earnings^as Jhown in Lblf ^ estimated an- 

^e\^ in fiscal ' 

PerioTl^To™^^ *>r the within-program 

received in the three monS^bef orl ^l e^" 93 ^ 3 ** ° U Wag6s 
that participants realized sub^^sf? enrollment ,. they show 
while they were in CETA ' increases in earnings 

service typefwere around SSo^.S 9 ? + S? W ' a "°S iataS with 
the fiscal 1976 particioant* ™ " * l J 31 P ercent for.PSE) for 

the- jo b.training P to i249 percent fol iLflT + ' 24 PerC6nt f ° r ° n ~ 
for -the January-June 1975 orouo SerESnJ se 5 vlce employment 
annualized earnings are natural ? ercen t a 9 e <*anges in average 
force participation Selore e^rv^o Closel * to lev els of labor 

expected to vary across servJc^ty^es wHa^d??? ^ Ca ° be 
pre-CETA labor force exoeripnnL « . • • differences in the 
CETA services in tables 8 and 9 r ? artlcl P ants ^ *>ur types of 
were substantial for participant Itl*^ ^ P re ~ CETA Period 
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*■ Ancillary employment services include counseling, testing, work 
orientation, coaching, job referral, and followup. Support serv- 
ices include medical and other health care, child care, trans- 
portation, and residential support. 

Nearly half, or 44 percent, of the January- June 1975 par- 
ticipant sample received some form of ancillary service. Forty- 
two percent received an employment service and 8 percent a sup- 
portive service. (Westat, 1981bf| For the fiscal 1976 sample, 
the corresponding proportions were 47 percent overall--43 per- 
cent employment, 13 percent supportive. (Westat, 1979a These 
percentages are probably underestimates given that ancillary 
services provided by subcontractors may go unrecorded. The in- 
tensity and quality of the services is unknown, but a large pro- 
portion of CETA participants received some form of additional 
assistance beyond that for skill training and jobs. 

Participant satisfaction with services also gives us a clue 
about the quality of programs. In the 1975 sample, 88 percent 
of the participants reported being either satisfied or very 
' satisfied with CETA. In the fiscal 1976 sample* 86 percent did 
the same. (Westat, 1979a) Across the types of service, reported 
satisfaction levels varied little. 

PARTICIPANTS' EMPLOYMENT STATUS 
AT PROGRAM TERMINATION 

prime sponsor reports give data on participants' termination 
status for the Comprehensive Services and combined PSE titles 
for fiscal years 1975-80T (DOL combines PSE data across titles 
'because of the many transfers back and forth between them m 
CETA's later years.) Data are also available by service type 
from the Continuous Longitudinal Manpower Survey for the January- 
June 1975 and the fiscal 1976 samples. 

According to the, DOL data shown in table 13 on page 52, the 
percentage of participants in Comprehensive Services leaving the ♦ 
program between fiscalYl975 ahd fiscal 1980 in a positive status 
averaqed fairly constantly about 70 percent, except for 197 5, when 
it was 61 percent'. These people had been placed in a job, were in 
school, had^oined the armed forces 0 , or were engaged m an activ- 
ity that would increase their employability . ^ , 

The p^Joportion -who were placed in jobs was slightly less 
than a third through 1976 but increased to 37 to 45 percent in 
later years. At least hal£ of those who were placed had received 
some form of CETA training, employment, or support service be^^nd 
intake, assessment, and referral services. 

v Fewer than one-third of the participants left the pkagram 

V in a nonpositive status, except for the first year, when the 

percentage was 39. These were people who after they terminated 
were unemployed, had left the labor force, did not continue^- 
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Table 13 

Status of Termmees for Comprehensive Services Title IIB-C 
for Fiscal Years 1975-80 (in Percent) a/ 





1975 


1976 


TQ1976 


1977 


1978 


1979 


1980 


Positive b/ 
















Direct placement 


} 10 


9 


8 


6 


9 


8 




Indirect placement 


I 15 


16 


15 


24 


24 


24 




Self-placement * 


6 


6 


5 


8 


11 


12 




Total placement 


31 


31 


28 


39 


45 


44 


37 


Other c/ 


30 


37 


41 


31 


27 


29 


31 


Total positive 


61 


68 


69 


70 


71 


72 


68 


Nonpositive d/ 


39 


32 


31 


30 


28 


28 


32 



Source: U.S. Department of Labor, Employment and Trainm^Administration. * 

a/Fiscal years 1975 and 1976 begin July 1; fiscal years 1977-80 begin October 1. 
TO 1976 # the transition quarter July 1 .to September 30, 1976, is a bridge between 
1976 and 1977. Totals may not add because of rounding. 

b/ Direct placement was in unsubsidized employment after receiving only intake, 
assessment, or referral service from CETA. Indirect placement was in unsub- 
sidized employment after participating in CETA training, employment, or support- 
ive service. Self-placement refers to obtaining unsubsidized employment without 
CETA placement assistance. The total includes all enrollees who entered unsub- 
sidized employment. 

c/Other includes intertitle transfers, people who terminated from the program and 
enrolled full tinte in an academic or a vocational school, entered a branch of the 
armed forces, enrolled in a manpower program not funded by CETA, or engaged in 
some other activity that increased the individual's employabi 1 lty . 

d/All individuals wh\terminated frc?m the program and did not have positive status. 



Table 14 



Status of Termmees for Combined Public Service Employment 
^atles I ID and VI for Fiscal Years 1975-80 (m Percent) a/ 



Positive b/ 

Direct placement 
Indirect placement 
Sel f-placement 

Total placement 
Other c/ 

Total positive 

Nonpo^itive d/ 



1975 


1976 


T01976 


1977 


1978 


1979 


1980 


2 




2 




* 1 


0 


0 




16 




22 


a* 


26 


18 


23 




13 




14 


14 


15 


16 


16 




31 




38 


41 


42 




39 


35 


9 




8 


8 


9 




11 


9 


:= = 




at — 


3 3 










40 


46 


49 


51 


42 


50 


44 


60 




54 


. 51 


49 


58 


50 


56 



Source: M.S. Department of Labor, Employment and Training Administration. 



begin October 1. 

is a bridge between 



a/Fiscal years 1975 and 1976 begin July 1; fiscal years 1977-80 

™ TO 1976, the transition quarter July 1 to September 30, 1976, 
1976 and 1977, Totals may not add because of rounding. 

b/ Direct placement was in unsubsidized employment after receiving only intake, 
assessment, \>r referral s-er vice| from CETA. Indirect placement was in unsub- 
sidized employment after participating in CETA training, employment, or support- 
ive service. Sel f-placement refers to obtaining unsubsidized employment without 
CETA placement assistance. The total includes aLl enrollees who entered unsub- 
sidized employment. ' * * 

c/ Other includes people who, terminated from the program and enrolled full time in 
an academic or a vocational school, entered a'branch of the armed forces, enrolled 
in a manpower program not funded by CETA, or engaged in some other .activity that 
increased the individual's employabil ity . It excludes intertitle transfers., 

d/All individuals who* terminated from the program and did not have positive status- 
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ucation or training, or were not doing any of the activities 
within the positive category* 

Comparable termination fetatus data for the combined PSE 
titles are given in table 14. People in the positive category 
fluctuated between 40 and 51 percent, with the low of .40 per- 
cent^ occurring in 1975/ the first year, and a dip later in 1978 
to 42^ percent. These figures are lower than those for the Com- 
prehensive Services title, but thj& difference may be partly from 
excluding transfers between CETA titles from the "other positive 
status' 1 category, as noted in table 14. Indeed, placement rates, 
as given in the "total placements" category, for the Comprehen- 
sive Services and PSE titles were roughly similar. 

The PSE placement rate ranged from 31 to 42 percent, with 
low points in 1975, 1978, and 1980. The low placement rate for 
1975 may be a function of CETA ' s startup, while the 1978 dip may 
mean tha^T^ss attention was paid to transition activities for 
placement during PSE's buildup. No explanation is offered for 
the 1980 dip. * 

The percentage of terminees assigned to the nonpositive 
category fluctuated between 49 and 60 percent, with the poorest 
performance in the first year of operation. This category, for 
PSE as for Comprehensive Services , contains people who were out 
of^the labor force as well as others who were unemployed . Al- 
though the figure for the nonpositive category appears to be 
high, it is important to consider that PSE participants tended 
to be less disadvantaged overall than participants in the Com- 
prehensive Services title. They may thus have b£n more likely 
to engage in prolonged job searches on their ow<^:han to secure 
immediate employment through CETA referral services. The higher* 
percentage of self-placements for the PSE titles (13 to 16 per- 
cent) compared to the Comprehensive Services title (5 to 12 
percent) supports this hypothesis. \ 

Data from CLMS on the' termination status of CETA partici- 
pants are more specific (although somewhat dated) in that they 
provide information by type of ser^i^e rather than title. 
(Westat, 1979a) For PSE services, we should expect not much 
difference in the coverage of the participant group, but the 
in-school youth work experience' programs of title IIB-C are 
excluded, as are counseling and job referral services. 

Table 15 on the next page presents CLMS data on labor force 
status at one day after termination for the fiscal 1976 sample. 
Nearly 70 percent of participants in on-the-job training and in 
*PSE reported being employed upon termination from the program. 
Of the participants in work experience, 55 percent were employed ; 
the lowest figure, at 39 percept, was for participants in class- 
room training. 

These figures make the same pattern in revers'e for unemployed 
terminees, -with as many as ^ quarter to a. third of work experi- 
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Table 15 



Estimated Labor Force Status One Day After Termination 
by Service Type for Fiscal Year 1976 (m Percent) a/ 



Training Employment 

Work Pubiic 
exper ience ser vice 



Classroom On-the-job 



Employed 39 
Unemployed 29> 
Not m labor force b/ 32 17 



69 55 67 

14 19 17 

26 16 



Source, westat, inc.. Continuous Longitudinal Manpower S urvey, 
Follow-Up Re port NO. 2 (Washington, n r . r n c P - r jr> 
ment of Labor, March 1979), appendix d, tables 14-17, 

a/ Percentages are computed within each service type. 

" t*l frll/V 91 * P rira * rii y ^ ^hool or training, serving m 
the armed forces, institutionalized, and not looking for work 
because of family responsibilities, illness, disability or 
some other reason. , ««w.n.n-y , or 



ence and classroom training participants beirig reported' out of 
the labor force (not. working or looking for work) at the time 
they left CETA . For the January-June 1975 sample, the patterns 
are parallel, lending credibility to the fiscal 1976 figures. 

t ^ With the exception of the figures for classroom training, 
employment rates are greater than 50 percent. The 39 percent 
rate for classroom training should be -viewed in relation to the 
characteristics of the participants. Those who engaged in class 
room training in fiscal 1976 'were among the most disadvantaged 
of all.enrollees in adult services, as we saw in table 8. 'work 
Experience participants, howeveV, were. also relatively disadvan- 
taged; thus, the lower employment rate at exit for terminees 
from classroom training mfcy have something to do with its beinq 
the only service type that does not involve direct- exposure to 
.employers. We can only speculate, but if employers are more 
likely to hire people they know, classroom training terminees 
may faqe greater difficulty in immediately translating their 
acquire\skills into jobs than do terminees from other services 
• * y\ • "\ „ ' ' , 

There are large discrepancies in the CLMS "entered employ- 
ypnt rates reported in table 15 and the DOL "placement" rates 
reported m tables 13 and 14.- The fiscal 1976 PSE employment 
rate shown m table 15 from CLMS data is 67 percent^ the place- 
ment rate shown in table 14 -from DOL' data for the 66mbined PSE 
titles for fiscal 1976 is 38 percent. Employment rates for the 
~r„t r se 5*Y lce tv P es similarly ranged from 39 H^n69 percent in - 
CLMS , while placement for the Comprehensive Services title is" ' 
outside this range, at 31 percent for fiscal 1976. 

One explanation for these 'differences is, of course, in' 
the CLMS sampling frame of adult-oriented services as contrasted 
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with the universe of services covered by the DOL prime sponsor 
reporting system. T*'e explanation is especially useful in ac- 
counting for the Comprehensive Services title data since the 
title's administrative data include in-school youth services. 
But another explanation is in the source of the data itself. 
Placement rates by title came from prime sponsor administrative 
records ?• CLMS employment rates one day after termination were 
constructed jointly from prime sponsor records and interviews 
with program participants. Even while it is probably true that 
collecting data from people retrospectively about their labor 
force status is subject to distortion, it is also likely that 
the. prime sponsor administrative records on placement rates 
underreport the number of people who moved directly into employ- 
ment when they left CETA. For example, people who left CETA 
because they obtained employment may appear erroneously on prime 
sponsor -records as nonpositive terminees if they failed to in- 
form program personnel of the reasons for their leaving. For 
PSE, underreporting in fiscal 1976 may have been by as. much as 
29 percent . 

Placement rates can reflect' many things—effectiveness of 
services, intensity of job referral 'assistance, quality of gobs, 
skills and motivation of job s.eekers, compulsiveness of record- 
keepers, are among them. The CLMS and administrative data 
indicate that in fiscal 1976 anywhere from 31 ^o 69 percent of 
participants in services under the Comprehensive Services title 
were employed at the time they terminated from the program? the 
percentages for PSE participants were' 38 to 67. The percentages 
depend on both the type of service and the source of the data. 

The CLMS percentage of fiscal 1976 participants reporting 
themselves unemployed one day after termination— 14 to 29 per- 
cent, depending on the type of service — compares favorably with 
the figure of 32 percent unemployed during most of the year be- 
fore CETA. Yet -employment rates at termination are not ah ade- 
quate measure of CETA's effectiveness. They do not give us in- 
formation on job quality, the opportunity it "of fers for upward 
'.movement, its stability and wage rate, or the degree to which 
•it enables the person to earn what is necessary to become self- 
sufficient. 

SUMMARY 

Significant proportions of enrollees in the Comprehensive 
Services and public service employment titles were disadvantaged 
economically and educationally when theyj entered the program and 
they had little past employment stability. Approximately one- 
third of those who enrolled^Mn the four major adult services be- 
tween fiscal 1976 and fiscal 1978 were unemployed at least 50 
percent of the year preceding their enrollment, and another one- 
fourth to -one-third were out of the labor force at least 50 per- 
cent of that year. From 71 to 78 percent of the fiscal 19,75, 
1977, and 1979 Comprehensive Services title IIB enrollees were 

n . 



at or below the OMB poverty level. In fiscal 1979, 68 and 63 
percent of pse titles IID and VI enrollees were at or below the 
OMB poverty level; in 1975, the economically disadvantaged con- 
stituted only 44 to 48 percent of all PSE enrollees. Sliqhtly 
more than one-fourth of the fiscal 1979 enrollees were hiqh 
school dropou-cs . • 

~° Ver ^ he l 975-80 Period, the mix of services received under 
the Comprehensive Services title shifted in the direction of 
increasing the services designed to foster the acquisition of 
JOD skills rather than job experience. The shifts in function 
areas of public service employment jobs between fiscal 1976 and 
riscal 1978 appear to have been consistent with efforts to dis- 
courage the use of PSE workers to support the ongoing services 
of local governments. 

The within -program occupational experiences of participants 
differed by type of service, at least for fiscal 1976. Public 
service employment and work experience concentrated in the cler- 
ical, service, and laborer occupational areas. Classroom training 
also emphasized the clerical, but both classroom and on-the-job 
training placed more emphasis on craft and operative occupations 
than did either public service employment or work experience. 
Shifts in service mix in the Comprehensive Services title since 
1976' and changes in eligibility criteria and wage restrictions 
•under the Public Service Employment titles may have altered this 
■relationship somewhat. 

The characteristics of participants ''varied across service 
types. In fiscal years 1976 and 1978, t;he least disadvantaged 
of CETA participants received on-the-job training services, 
while the most disadvantaged received classroom training and 
work experience. in fiscal 1976, PSE participants, like on-the- 
job training participants, were relatively less di sadvantaqed , 
but in fiscal 1978 the profiles of PSE participant characteris- 
tics appeared to be more similar to those of participants in 
classroom training and work experience. 

Participants in on-the-job training, work experience, and 
public service employment during January to June 1975 'and fiscal 
laze^realized substantial improvements in their earnings while 
they Were enrolled in CETA over their pre-CETA earnings. Addi- 
tionally, nearly half of the participants in CETA adult services ' 
in the same period received some form/of ancillary employment 
and support services " beyond skills training or subsidized work 
opportunities. Moreover, the overwhelming 'majority—more than . ' 
bb percent — of the participants* in CETA adult services durinq 
January-June 1975 and fiscal 1976 reported being either satis- 
fied or very satisfied with. the program. 

National placement rates at termination for participants 
in the Comprehensive Services title ranged around 30 percent in 
early years and moved closer to 45 percent in later years. 
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Placement rates for the PSE titles fluctuated between 31 and 42 
percent. 

CLMS data on labor force status at termination, constructed 
from prime sponsor records and interviews with participants m 
adult services for January to June 1975 and fj^al 1976, pro- 
duced rates- much higher than those obtained from DOL s P"me 
sponsor reporting system for 1976. PSE participants reported 
an "entered employment at termination" rate of 67 percent, and 
the other percentages were 69 for on-the-job training, 55 for 
work experience,' and 39 for classroom training. These data 
indicate that DOL national data on termination status may under- 
estimate the percentage of people actually entering employment 
after CETA. 

Summing all this up in brief, we can see that CETA was re- 
focused over time to serve the disadvantaged and that after this 
refocusing the participant profile of public service employment 
shifted more toward the disadvantaged. Programs that are de- 
signed to match participants 1 needs and interests with employ- 
ment and training services and that are administered locally 
are also very complex. As a result, the implementation data 
must be interpreted carefully. For example, while the profile 
of relatively less disadvantaged participant characteristics 
for on-the-job training services may initially appear undesir- 
able, it is consistent with the definition of on-the-job train- 
ing as a service suitable for people who are ready for jobs and 
can move into an employment setting and acquire occupational 
skills within that setting. The profile of the more disadvan- 
taged work experience participants is consistent, too, with the 
usi of this service as one that is appropriate for people who 
have little or no recent employment experience. 

Participants in at least the early years of CETA realized 
several benefits while they were in the program, yet their earn- 
ings gains within the program must be viewed in the context of 
their .relatively low earnings in the quarter preceding their 
enrollment. Substantial numbers obtained employment at termi- 
nation, but placement at termination is not necessanry related 
to their long-term earnings Igains. Moreover, as we noted in 
chapter 3, the placement rate data are not a satisfactory measure 
of overall program effectiveness and should h€ viewed instead as 
only descriptive of immediate postprogram experience. 

Even sophisticated analysis techniques cannot completely 
adjust for all differences In group characteristics. When we 
compare service types, therefore, we must try to know as much 
as possible about the characteristics of the participants and 
the content of the services that were provided to them. This 
knowledge is important to our interpretation and understand- 
ing of outcome and effectiveness data. From the information 
presented in this chapter, for example, we would anticipate 
superior outcomes for participants in on-the-job training 



compared to other services as a function both of their W«„ 
less disadvantaged and of the higher-wage occupatiSna 1 areas 

tftion'r^ 9 th e Y received « ^ would have the oppose expec- 
tation for work experience* a^oa*.© expec 
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CHAPTER 5 



CETA PARTICIPANTS' EXPERIENCES 

BEFORE AND AFTER PROGRAM PARTICIPATION 

In this chapter, we describe the experiences of terminees 
from adult CETA services and contrast these experiences with the 
period before CETA. This gives us a rich descriptive picture from 
tKe participant perspective. The data we present are suitable for 
descriptive purposes only, however. They tell us about gross 
changes between the preprogram and postprogram periods, but they 
do not permit us to draw conclusions about program effectiveness. 
In other words, it is not possible to state whether terminees ' 
would have had these experiences in the absence of the program. 

We drew our information mainly from the second and third 
*ollowup reports of the Continuous Longitudinal Manpower Survey 
(CLMS) which cover new enrollees in CETA between January 1975 and 
June 1976. CLMS is an ongoing effort by DOL's Office of Policy, 
Evaluation, and Research to track t*e experiences of CETA ter- 
minees and evaluate the program's effectiveness. It includes 
proqram records and individual interviews of some 11,000 people 
annually at 3, 9, 18, and 36 months after their entrance into 
adult-oriented services. «— 

Our descriptions in this chapter include earnings, hourly 
wage rates, percentages of time employed, percentages of termi- 
nees employed', receipt of public benefits and Unemployment In- 
surance, and types of employer and job. 1/ When possible , we 
describe experiences both before CETA entry and after termina- 
tion, and our emphasis is on, first, outcomes for adult services 
overall and, second, outcomes by service type. We summarize 
•outcomes for demographic subgroups only briefly. 

, Our data are for three groups of terminees. One group 
contains ' 24-month terminees— participants January to June 1975, 
newly enrolled, and in CETA for at least 8 days, and, by 36 
months after entry, terminated from the program for a minimum 
of 24 months. A second group contains 12-month terminees— par- 
ticipants in fiscal year 1976 (July 1975 to June 1976), newly 
enrolled, and in CETA for at least 8 days, and, by 18 months 
•after entry, terminated from the program for a minimum of 12 
months. A third group, of which the second is a. subset, contains 
3-month terminees— participants in fiscal 1976, newly enrolled 
and in CETA for at least 8 days, and, by 18 months after entry, 
terminated from the program for a minimum of 3 months . For some 
variables, comparable data were not available for all three groups. 
In these cases, we summarized the experiences of one or both of 
the two others or used a'hother terminee group. 



1/Dollar amounts for wages and earnings reported in this chapter 
""have not been adjusted for inflation. 
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Using these groups, whose experiences were in many ways 
remarkably similar, allows ufi to search for consistent patterns 
of experience and heightens odr confidence when we find them. 
The groups do differ in several significant ways, however. 
First, the January-June 1975 people were on average less disad- 
vantaged than people in the fiscal 1976 groups. They also in- 
cluded people who transferred between titles, while such trans- 
fers were excluded from the fiscal 1976 data. Second, the mix of 
services provided in fiscal 1976 had shifted slightly more toward 
classroom and on-the-job training and, because postprogram out- 
comes are associated with service type, overall df^et comparison 
with the January-June 1975 group is therefore problematic. Fi- 
nally, the fiscal 1976 12-month terminees had had no more than 
6 months of exposure to CETA. This may also be a problem, since 
it has been found that length of time in CETA is associated with 
postprogram experience. (Westat, 1981a) other factors that may 
differ for the groups include labor market conditions at the time 
-of termination and the level of minimum wage. More complete dis- 
cussions can be found in the CLMS reports i < 

PARTICIPANTS' EXPERIENCES OVERALL 

Wages earned and time employed 

Average annualized earnings, average percentage of time em-* 
ployed, and percentage of people employed for one year before CETa 
and, as data were available, for up to 24 months, after termination 
are shown in tables 16, 17, and 18 (on pages 62 and 63), with- 
out distinction by title or service type. Average hourly wages 
received before and after participation by the fiscal 1976 ytermi- 
nee groups and a January-June 1975 12-month\;eEminee "group are 
shown in table 19. The patterns of labor for^re, experience for ■ 
.these groups are fairly similar.,, except that the preprogram ex- 
perience of the January-June 1975 group was the most favorable. 

' With respect to average annualized earnings, all three groups 
show consistent patterns of decreased earnings during the year 
preceding entry into CETA and increased earnings in the y^ar after 
CETA. The 1975 group had slightly, greater earnings in the fourth 
and second quarters before entry but resembled th§ 1976 terminee 
groups m the quarter immediately before enrollment. When they 
entered CETA, all groups had extremely low annualized earninga-- 
no higher than $1,710. Three months after they terminated , /their 
average annualized earnings ranged between $3,680 and $3vi^D fkr 
superior to the preceding year. The .fiscal 1976 12-month termi- 
nee group demonstrated further improvement 10 to 1*2 months after 
termination, rising to $4,990, and the 197 5' group improved from 
an average $3,690 1 to 3 months, after leaving the program to an 
average $5,800 22 to 24 months after leaving it. 1/ 

1/Average annualized earnings in table 16 are based on all ter- > 
minees, including the unemployed.. Considering only .terminees 
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Figure 4 

Average Annualized Earnings Before and After CETA 
for Terminees Who Participated January ■ June 1975 and Fiscal Year 1976 
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We show the average annualized earnings patterns in figure 4. 
Part of the explanation for the postprogram increases in earnings 
can be found in increases in the percentage of time tjiesfe indi- 
viduals reported being employed after GET A participation. During 
the year before their enrollment, their circumstances had been; 
deteriorating from an average of employment 43 to 53 percent of 
the time 10 to 12 montihs before entry to an average of employment 
only 29 percent of ttve time in the 3 months immediately preceding 
enrollment- After leaving the program, they reported being em- 
ployed an average of 53 to 56 percent of the time in the first 
3 months, increasing this to 61 to 65 percent at 10 to 12 months 
and 68 percent, for the 24-month terminee group, at 22 to 24 
months. x 



yho worked, corresponding figures for fiscal 1976 3-month and 
12-month terminee groups are slightly more than $5,000 1 to 3 
months ^fter CETA and $7,300 10 , to 12 months afterward. 



Table 16 

Average Annualized Earnings of CETA Termmees 
Who Participated in Adult Services 
in January-June 1975 and Fiscal Year 1976 



Months after termination 

_ FY" 1976 J January-June 1975 
A— 12 24 



Larn m^s before 
entry 

10-12 months * $2,760 $2,850 53,310 

4 " 6 " 2.050 2,070 2,740 

l ~ 3 " 1,560 1,600 • 1,710 

Lam m^s after Y' 

te ruination * • , * 

1- 3 months 3,930 3,680 3,690 

10-12 M (a) 4,990 • • 4,760 

22 " 24 " (a) (a) m 5,800 



Source: westat, Inc., Continuous Longitudinal Manpower 

Survey, Follow- Up Report No. 2 (.Washington, D.C. : 
U.S. Department of Labor, March 197 r 9), appendix 
D, tables 54 and 57, and Continuous Longitudinal 
manpower S urvey F oUow-Up Report No. 3 (Washmg- 
ton, D.C.: U.S. Department of Labor, January 
198,1), -appendix D, table 35- 

- a/Does not apply. 
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Percentage of Time Employed for CETA Terminees 
Who Participated in Adult Services 
in January-June 1975 and Fiscal Year 1976 



Months after termination 
FY 197 6~~ January^ June X9Ts 
3 12 2T 1 



Time period 

before entry 4 

1 0-1 2 months 44% 431 " 53% 

4- 6 36 36 45 

1- 3 29 29 29 

Time period 

after termination 

1- 3 months 56 53 54 

10-12 - (a) 61 65 

22-24 " (a) (a) 68 



Source: Westat, Inc., Continuous Longitudinal Manpower 

Survey, Fol low-Up Report No. 2 (Washington, D.C. : 
U.S f , Department of Labor, March -1979), appendix 
D, tables 56 and 59, and Continuous Longitudinal 
Manpower Survey, Follow-Up Report No. ji (Washing - 
ton, D.C: U.S. Department of Labor, January 
1961), appendix D, table 34. 

a/Does 'not apply. 
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. > ' , Table 18" 

' 'percentage of CETA Termmees Employed Who Participated 
in Adutt Services in January-June 1975 and Fiscal Year 1976 



Months d£ter termination 
"FY 197*6 January-June 1975 



TT~ 24_ 



Percent employed ^ 
before entry 
' 12 months 



44 43 52 



3 months 33 33 36 



I day. 



24 "24 25 



percent employed * ^ 

. « after termination « , 

> 3 months 55 '53 57 

12 " (a) 60 ' 6* 



Sources Westat, Inc., Continuous -Longituainal Manpower 
Survey, Follo wKJp Report No. 2 (Washington, D.c 



U.S. .Department of' Labor, March 1979 appendix 
D, tkblp 42, and Continuous Longitudinal Manpower 
.Survey; Fol lo w-Up ^Report No. 3 ('Washington, D.C; 
U.S. Department of Labor, January 1981), appepdix 



table. 32. 
a/Does not apply. 



Tabl<? 19 ' 

Average Hourly Wages of .Employed CETA Terminees 
Who Participated in Adult Services 
" in January-June 1975 "and Fiscal Year 1976 



Months after termination 

FY 1976 January-KJune 1975 



T2T" 12. 



| j Wages before 

V • en ^0-12 nvonths $3-16 ,$3.18 • M.19 

6 J. 4 " 3.09* 3.09 3.25 * 

3 - i - ■ •« .3.06 3-10 3.10 ^ 



Wages after , 
termination 
1- 3 months* 
10-12 , " 



a. 35 3.30 , , 3.20 

(a) 3.77 3.54 



Source: WestatT, Inc., Continuous Longitudinal Manpower 

-Survey,. Follow-Up Report Nq' A _2 ^Washington, P.C. : 
, U.S. Department ot Labor, Mar,ch 1979), appendix- % 

l D, tables 55, 58, and 76. ( 

. # 

a/Does, not apply. • * . ' 



The percentage of people employed shows a similar pattern. 
Here the data are for points in time rather .than quarters- Only 
about 2 5 percent of these CETA participants reported being' em- 
ployed at the time they entered CEJTA, but approximately 55 per- 
cent were employed three months aft;er they left CETA, and their 
labor force participation! 'increased in subsequent months. Sixty- 
eight percent of the 1 975^romj^fepQrted bei/ig employed 2 years * 
after leaving CETA, 43 pwhrtrfft more than when they entered CETA 
and 16 percent more than a, year bef ore/enrollmeat > * 

Tlve data on average hourly wages displayed in table 19 show 
that before CETA there' was little f luctuation^in reported wage 
levels. The deteriorating- economic ctrcum$tance^noted for these 
groups in £he year before CETA appears', thus, tjsTna^e been a 
function of their having worked less during the year before entry. 
One to 3 months ^fter CETA, only slight improvement can be seen 
in wage levels, T5ut for fiscal 1976 and Januatfy-June 1975 12-month- 
terminee groups, moderate improvement is evident 10 to 12 months 
after termination. % 

Table 2Q summarizes all these changes for January-June 1975 
and fiscal 1976 12-month terminees . It gives figures both for 
changes in group averages from tfce first quarter preceding entry 
into CETA to the fourth quarter after termination and for changes 
from the fourth quarter preceding entry to the fourth quarter 
after termination. This translates into comparisons of experi- 
ences 1 to 3 months before enrollment and 10 to 12 months before 



1 20 * 

it^r ,e lute vhanjes in Average Annualized- harnings, 
'^m )e 'iuun, v»a^es, and Average Percentage of Time 

tor ,^- v iontn it j A lerminees Who Participated 
J ji'ootvKes in Janiar y- June 19*75 and fiscal Year 1976 



ji'ii r i ion icist* lrpi variable January-June 197 5 FY 1 976 

«► 

wad.'te: bet ^ro entr/ 

t > 4th \ carter 

i f ' er • et Mild t lou 

> 

Aveiaje annualize] earnings +$3,040.00 +$3,390*00 

AveVa je hour,ly wages a „ +$0.44 +$0.67 

Average time* employed +30% +32% 



4th quarter before entr> 
t ) 4th quarter 
dtter term ina t ion 



Average dnnu<i 1 1 zed earnings +Y^» 280.00 +$2,140.Q0 

Average hourly wages a/ +$0.35 ' +$0.59 

Average time employed ^ +8% +18% 



bourse: westat, Inc., Con tmuous Lon g i t ud l na J Ma jipowe r Survey , 
r o 1 1 ow Up Repo r t No T 2 ( Wa sh l ng to o ~ D/cY: U.S. Depart- 
ment" of 'Labor f March 1979,), g. 6-78x 

a change in average hoyirl/ wages is calculated only for people 
employed m both the quarter before entry and the quarter 
ifter termination. "* 
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enrollment with experiences 10 to 12 months aftfer termination. 
The first comparison shows large increases on all three measures, 
since it contrasts each CETA group's experiences at its lowest 
point in the year before CETA With its experiences almost one^ 
year after the program. To the extent that this period immedi- 
ately before enrollment does not reflect normal circumstances for 
r people in these groups, these figures are inflated estimates of 
• change. ' v « 

The second comparison — fourth" quarter before compared with 
fourth quarter after — is more conservative. By using data o n 
labor' force experiences 10 to 12 months before entering CETA as* 
the baseline, it contrasts what may h^ve been the more typical- 
circumstances of these people with'their experiences 10 to 12 
m6nths after leaving CETA. The decision $s to the most appro- 
priate baseline for pre-post comparisons rests: on whether one 
believes that participants' circumstances immediately before the 
program would have remained at this level in the absence of the 
program. v We have elected to use the more conservative comparison 
for most of our presentations in this report. Even* this conser- 
vative comparison, however, shows /that both groups increased their 
average annualized earnings, average hourly wages, and average 
percentage of time employed. While some proportion of the pre- 
post earnings and wage gains are probably a function of infla- 
tion, .the fact that increases also occurred for the percentage 
of time employed and, as documented in table 18,, for the percent- 
age of people working argues against inflation accounting for 
all the increase. The 1975 group increased $1,280 in average 
annualized earnings, $0.35 in^hourly waggs, and 8 percent in per- 
centage of time employed. The 1976 group had larcte and positive 
* gains oti all three measures — $2,140, $0.59, and 18 percent. The 
larger increase's. for the 1976 group may he a function of their 
greater disadvantage before CETA or the improved economic condi- y 
tions at the time ojf their exit. 4 ^ 

Grouping fiscal 1976 12-month terminees^ into categories ac- 
cording to their .earnings change patterns frim the fourth quarter 
before .CETA to the fourth quarter after CETA, Westat summarised 
the itesu^fts as follows: ^ ; 

Terminees were classified as gainers if their post- 
<CETA annualized earnings were more than 10 percent ^ 
higher than, they were in the fourth quarter before 

rCETA entry; as recoyerers if their annualized earnings 
after termination v»re within" 10 percent of tb4ir pre- 
CETA earnings; as nonrecoverers if their post-cETA 
annualized earnings were more than 10 percent lower 
than 'their pre-CETA earnings ^ and as noftearners if 
thdy had no earnings in either comparison quarter. 
Over half (53 percent) of the 12-month terminees were 
gainers, 5 percent were recaverers, one-fifth were non - 
recoverers, and another fifth were) nonearners [emphasis 
added]. This distribution is generally similar ^ong^ 
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the terminees who entered CETA between January and June 
1975 [12-month terminees], except that the earlier group 
includes slightly more nonrecoverers and slightly fewer 
gainers and nonearners . (Westat, 1979a, pp^. 1-16) 

Public benefits received ' 

One criterion for assessing Jthe effectiveness of employment 
and training programs is whether they enable participants to 
become self-sufficient. Sources and amounts of "other income"-- 
public benefits and Unemployment Insurance (UI) payments — should 
.tell us something about this. ,Table 21 summarizes these data 
for January-June 1975 24-month terminus for before and after 
CETA. 



These data should be interpreted-^autious;y. Except for UI 
they refer to households, not individuals; a participant*' s cif- ' 
c^mstances could have improved substantially while the household 
%s ftill' qualifying f # or some form of public benefit. It is also 
possible that the 'composition of some participant households 
was not the same after -CETA as it. was before G%EA, particularly 
for younq adult participants who became employed^fef te'r CETA and ' 
established independent households-* 



Despite its inadequacies, this is the only information avail- 
able that covers substantial time periods both before and after 
program participation. It shows that fully 38 percent of these ' 
terminees' households received at least one form of public bene-' 



Table 21 

Percentaqe 1 Distribution of 24-Month CETA Terminees 
Who Participated in Adult Servicei in January-June 1975 
by Receipt of Public Benefits and Unemployment Insurance 





Before entry 


\ 

After 


termination, 


One year 


1st year 2nd year 


Public benefits 






r 


At least one 


38 


32 


25 


None 


62 * 


68 


75 


Special benefit's a' 








Aid to Fam 1 ies~with 4> A 


14 


13 


11 » 


Dependent Children 2~S 








Supp 1 ement a 1 Secu r 1 ty 


3 


6 


4 


I ncome 








Other public assistance 


{ 7 


6 


5 


Food stamps 


28 


25 


1 7 


Housing assistance 


4 6 


8 


7 


Unemployment insurance b/ 








Some 


26 


22 


15 


None 


' 74 


78 


85 



T 



Source: Westat, Inc., Continuous Longitudinal Manpower Survey , 
Follow-Up Report ^o. 3 (Washington, D.C.: U.S. n»p*rt- 
ment of Labor, 'Jantiary 1981), appendix D, table 27. 

a/Two or more types of benefit may be received simultaneously. 
b/Respondent only. 
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fit in the year preceding CETA. The dominant public benefit was 
food stamps, at 28 percent of ' households , followed by.AFDC, at 
14 percent. In the second yea* after termination, the -percent- 
age of terminees' households that received some form of benefit 
dropped to 25, food stamps" dropped 'to 17, and AFDC dropped to 11 
percent. Twenty-six percent of the terminees reported receiving^ . 
UI payments in the year before CETA, 22 percent in. the first year 
after 'CETA, 15 percent in the secdnd year. 

The changes in receipt -of public benefits are somewhat diffi- 
cult to' interpret -given that eligibility criteria for programs may 
have changed in the interim and that the composition of terminee 
households may also have changed. Whether the dollar value of 
transfer payments increased or decreased is also not, known. It 
is possible, for example, that th# improved employment status of 
terminees resulted in reduced allotments of food stamps. That 
25 percent of terminee households still sought and received bene- • 
-fits two years-after CETA demonstrates that CETA was not able to 
create gains in earnings sufficient to enable total independence 
of the 'terminee household. This is a strict criterion for assess- 
ing program effectiveness. However, we .have no information on 
the, amounts of benefits received or whether -rel iance on public 
benefits would have increased in the absence of the pro'gram beyond 
preprogram levels. Likewise, the 15 percent of terminees receiv- 
ing UI payments in the second year following CETA must be put in 
the' context of the employment opportunities available at that 
tine and must be qualified by- the fact that we lack information 
on amounts an* durations of payments as well as whether . individ- 
uals'had exhausted their *t eligibility. 

• . v • ' , 

Private sector employment 

*** In recent years, CETA has increasingly emphasized the fj6\e- 
ment of participants into private sector jobs. (We discuss /this •, 
in 'connection vfith title VII in chapter 7.) Since mostnew/ jobs 
are in the private rather than the public sector, one me^Ure 
of CETA's success 'as a' training program is the degree to which 
its terminees obtain private . sector employment. Which sector 
January-June 1975 24 T month terminees held jobs in at varidus 
' times before and after CETA is summarized in table 22 on the 
next page., j 

Focusing only on the "all services" column, we see that the 
percentage of employees in the private 'sector decreased in the 
'year before fcETA from 82 to 66 percent; after CETA, it stood at 
44 percent and increased slowly again to 66 .percent, never reach- 
ing the 82 percent level of 12 months before /entry . Westat also 
summarized this experience: / • v ' 

Over tho^ two post-CETA years, "the percent of terminees 
who wefie in public employment decreased sharply although 
the number of these terminees remaiped relatively 
stable. This is because private employment increased 
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Tablo ^2 

Percentage of Employed' 24-Month CETA Terminees 
Whose Primary Jobs Were with Private Employers 
and Who* Participated in Adult Services 
in JanuaryCjune 1975 a/ 





CT 


OJT 


WE 


PSE 


All 
services 


Time before 












entry 












> 12 months 


90 


86 


79 


78 


82 


1 month 


85 


85 


71 


49 


66 


Time after 












termination 












1 day 


"83 


84 


36 


* 23 


44 


1 month 


82 


. 84 


46 


39 


56 


3 months 


• 81 


85 


54 


47 


61 


12 


84 ' 


84 


':62 


47 


63 


24 


84 


83 


65 


' 52 


66 



Source: Westats Inc., Continuous Longitudinal . 

Manpower Surrey, Follow-Up Report No, 3 - 
( Washington, D.C. : U.S. Department of 
Labor, January 1981), appendix D, table 

a/CT is classroom training, OJT is on-thtf-job 
training, WE is 'work experience, and PSE is 



Q,r^ % public service employment, 



I 




3 




Table 2 3 



Percentage of Employed CETA Terminees Whose Primary 
* Jobs Were with Private Employers and Who Participated 
x in Adult Services in Fiscal Year 1976 
by Service Type a/ 



Months after 
termination 


CT 


OJT 


W£ PSE 


All 
services 


3 -month 

3 . 
12 b/ 


terminees 


it- 

84 


90 


58 51 
• 


70 , 


1 2r-month 
* 3 'c/ 
12 


terminees 

\ 


88 


\ 

91 


68 63 


78 


Source : 


Westat, Inby 


, Continuous 


Longitudinal Man- 




power Survey 


, Follov/-Up 


Report No. 


2 (Wash- 




ington ,„ D.C . 
Marcht Ss y79) , 


: U 
pp. 


. S. Department of 
5-H and 5-16. 


Labor , 



a/CT is classroom training, OJT is on-the-job train- 
ing, >WE*is work experience, and PSE is public 
service employment. 

b/Does not apply, • " 

c/Not available. - " « 

— * 




j sharply over the period and so tptal employment, the 
base of the percentage, also* increased* Similarly, 
■ although there was a decline in the actual number of 
terminees who were in public employment during the pre- 
CETA year, there was an even, sharper decline in the 
number in private employment and thus the percent in 
public employment increased over the preprogram period. 
(Westat, J981b, p. 6-*2^) 

Prom table 23, it can be seen that 70 percent of employed fiscal 
-1976 3-month terminees were employed in th$ private sector 3' 
months after CETA arid that 78 percent of employed people in the 
fiscal 1976 'lg-month gfoup held jobs in the private sector 12 
months a.fter CETA, * Both these . figures are higher than the corre- 
sponding' figures for the 1975 group. 

PARTICIPANTS 1 EXPERIENCES 
BY SERVICE TYPE * 

Wages e^a'^ryed and time employed * * 

Average annualized earnings, average percentage of tlprS* 
employed, percentages of people "employed at selected tim^s, and 
average^ hourly wage rates, disaggregated ^ type of service at 
time of enrollment, are shown in tables 24 through 27 (on pages' ^ 
7'0-73) for the same terminee groups presented ' ear l,ier in the 
chapter . . The preprogram economic deterioration of all groups 
can be seen bn these measures. Looking earlier 'at differences 
in trie- characteristics of participants assigned to the four serv- 
ices, H/ We have already seen that people assigned t6 jwork experience 
and classroom training in .fiscal 1976 were relatively more disad- 
vantaged than others assigned to on-the-job training and public 
servj.be employment. * The average annualized earnings data in tabl^e 
24 are consistent with that observation. 

Terminees enroled in on-the-job training and public setrvice 
employment had higher average annualized earnings in the fourth 

"quarter preceding. C^TA^than^ did enrol lees in the two other serv- 
ices. The pattern <or average hourly wage rates for fiscal 1976 
terminals in the fourth , quarter before entry is identical. .On 

*the measures of percentage ^of time employed and percentacjfc, of 
people employed ^t selected times, the experiences ot^^rtfrk expe- 
rience enrollees in the fourth Quarter preceding CEtfA appear to' 
have been similar to the experiences of on-the-job training and 
public service employment. People in classroom training generally 
had the worst preprogram labor force experiences among the four 
groups , t * 

. Postprogranf experiences of participants in the four service 
types form a sidl>lar pattern within all three terminee groups 
with respect to/average annualized earnings, average percentages 

?f tine employee, and percentage of people employed at selected 
imes. 4 -On all khree measures, on-the-job training terminees 

< " • 

' - 69 '. 
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Table 24 



^Avera,ge Annual/zed Earnings of CETA Terminees Who Participated in Adult Services 
r * A in January-June 1975 and Fiscal Year 1976. by Service Type a/ 



FY 1976 : January-June 1975 



3-month terminees 12-month terminees"" " 24-month terminees 

CT OJT WE PSE CT OJT WE , PSE " CT OJT WE PSF 



Earnings befpre 
* * v entry * 

10-12 months" $2,140 $3,230 $2,600 $3,320 $2,240 $3,260 $2,790 $3,420 $2,600 $3,530 $3,080 $3* BOO 

4 r 6 " 1*530 2,510 1,700 / 2,560 1,530 2,480 1,770 2,640 2,1]0 3,290 2,350^3,120 

-J 1"3 " - 1*100 2,050 1,230 2,020 1,060 2,060 1,350 2,110 1,2<0 2,550 1 610 1 770 

° / / 

Earnings after * 

termination 

1-3 months ^3,290 5,080 3,220 4,470 2,940 4,720 3,230 4,260 '2,7^0 >4, 940 2,870 4,200 

"10-12" (bj " (b) ' (b) (b) * 4,280 6,030 4,050 5,770 3,9: 0 5,830 3! 810 5*260 

22 -^ \ (b) (b) (b) (b) Ob) (b) (b) (b) 4,850 6,920 4,440 6^520 



Source: Westat, Jnc . , Continuous Longitudinal Manpower Survey, ^Follow-Up* Report No. 2 (Washington, D.C.: 
U.S. De^ytment of Labor, March 1979)', appendix D, tables 54 and 57, and Continuous Longitudina l 

Manpower Survey, Fol low-Up Report No. 3 (Washington, O.C.: U .S . » Department of Labor, January 

1981), .appendix D, table 35. * * 



a/CT is classroom training, OJT is on-the-job' training, WE is work experience, and PSE is public service 

employment . • <* 

b/Does not apply. ^ s ' 



Table 2 5 



Percentage of Time Employed for* CETA TerjKlnees Who Participated .in Adult Services 
in January-June 1975 and Fiscal Year 1976 by Service Type a/ 











FY 


1976 








Jan»uary- 


June 


1975 


3 -month 


terminees 


12- 


month 


terminees* 


24- 


month 


terminees 


CT 


OJT 


WE 


PSE 


CT 


OJT 


WE 


PSE 


CT 


OJT 


WE 


PSE 


Time period before 


























entity 


























10-12 months 


37% 


46% 


46% 


48% 


37% 


46% 


47% 


48% 


45% 


57% X 


53% 


57% 


4-6 * 


30 




37 


41 


29 


40 


39 


41 ' 


38 


- 50, 


43 


48 


1- 3 


22 


34 


28 


34 - 


21 


36 


30 


33 * 


24 


40 


31 


30 


Time period a£t«*r 
























>\ 


termination 




















t 






1- 3 monthu 


49 


68 


53 


60 


44 


66 


53 


57 


44 


73 


52 


57 


10-12 


(b) 


(b) 


(b) 


(b) 


54 


70 


56 


68 


56 


76 


59 


69 


22-24 


(b) 


(b) 


(b) 


(b) 


(b) 


(b) 


(b) 


(b) 


60 


78 


61 


73 



Source: Westat Inc., Continuous Longitudinal Manpower Survay, Follow^l p Report No. 2 
(Washington, D.C.: U.S. Department of Labor, March 1979), appendix 0, tables 
56 and 59 , and Continuous Longitudinal Manpower Survey, Follow- Up Report No. 
3 (Washington, D.C. : U.S. Department of Labor, January 1981), appendix D, • 
table J4. 

a/CT is classroom" training, OJT is on-the-job training, WE is work experience, and PSE 

is public service employment. * 
b/Does not 'apply. 
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Table 26 



Percentage of CETA Terminees Employed Who Participated in Adult Services 
in January-June 1975 and Fiscal Year 1976 by Service Type a/ 



3-month terminees 
CT OJT WE PSE 



■FY 1976 



I 2-month terminees 



Percent employed* 
3 ' before ervtry 

12 months ' 37 46 48 

3 " 26 .39 35 

1 day 15 32 23 

* 

Percent employed 
after termination 

3 months 50 65 52 

\2 " « (b) (b) (b) 

24 " (b) (b) (b) 



CT 



January-June 1^75 
24-month terminees 



. OJT r WE 



PSE 



CT , 



OJT WE 



PSE 



48 
38 
29 



57 

(b) 

(b) 



37 
25 
15 



46 
54 
(b) 



45. 

40 

33 



64 

6B . 
(b) 



49* 
35 
26 



^2 
56 
(b) 



48 
37 i 
30 



54 
64 
(b) 



44 
31 
1 5 



48 
57 
61 



55 
45 
40 



71 

76 
78 



53 
36 
29 



55 
38 
25 



54 60 
59 68 
59 73 



Source s 



Westat, Inc., Continuous Longitudinal Manpower Survey, Follow-Up Report No. 
. . 2 (Washington, D.C. : U.S. Department of Labor, March 1979), appendix D, 

tables 48 and 51, and Continuous Longitudinal Manpower Survey, Follow-Up 
Report No. 3 (Washington, D.C : U»S. Department of Labor, January 1981), . 
appendix D, table 32. 

a/CT is classroom training, OJT is' on-the-job trainina, WE is work experience, and 

PSE is public service employment. 
b/Does not apply. * 




Table 27 



Average Hourly ^Wages of CETA Employed Tsrminees Who Participated in Adult Services 
January-June 1975 and Fiscal Year 1976 by Service type a/ 



CT 



3-month terminees 



FY 1976 



OJT 



WE 



PSE 



12 -month terminees 



CT 



OJT 



WE 



PSE 



Wages before 
entry 

10-12 months 
4- 6 
l-,3 

Wages after 
termination 

1- 3 months 
10- T2 



$2.99 $3.32 $3.06 $3.29 
2.90 3.23 2.81 3.29 
2.93 3.13 2.78 3.26 



3.33 3.43 2.98 3.50 
(b) . (b) (b) (bj 



$3 .05 
2,92 
:> . 99 



3.33 
3.70 



$3.31 
3.17 
3 .07 



3 .31 
3.86 



$3.09 $3.29 

2.80 3.31 

2.81 3.35 



2 .96 

3 .44 



3.47 
3.97 



January-June 1975 
12-month terminees 



CT 



OJT 



WE 



PSE 



?3.03 •l?3.00 
3.15 \3.01 
3 . 10 2n88 



$3.20 $3.33 
3.15 3.39 
3.02 « 3.20 



3 .11 
3 .48 



3 . 12 
3 .49 



2 .77 
3.17 



3.41 
3. 71 



Source: Westat, Inc. , Continuous Longitudinal Manpower Survey, Follow-Up Repcrt No. 2 (Washington, 
'D.C.: U.S. Department of Labor, March 1979), appendix D, tables 55, 58, and 76. 

a/CT is classroom training, OJT is on-the-job training, WE is work experience, and PSE is publ/c 

service employment . ' 
b/Does not apply. ' 
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fared the best and were followed by public service employment 
terminees. The others had much poorer outcomes — from $1,006 to 
$2,500 less in average annualized Earnings and approximately 
from 5 to, 20 percent less }n average time employed and in people 
♦employed at selected times. 

* ' 

The average hourly wage rate data deviated somewhat from this 
pat tern . t When classroom training terminees were employed after 
CETA, their hourly wages were evidently not much lower than the 
hourly wages of 'terminees from on-ther job training and public 
service employment. Work experience terminees, however, reported 
hourly wages approximately $0.25 to $0.65 lower than terminees 
from the, other s/ervic^s. This was found across a 1-1 times and 
within all groups. , 

Changes in average annualized earnings and average percent- 
age of time employed for fiscal 1976 12-month terminees and 
January-June 1975 24-month .terminees are shown in table 28. 
Average hourly wage rate data were not available in this form for, 
all groups. These comparisons use a conservative baseline period 
of 10 to 12 months before program entry. 

The same relative ordering of service types holds for changes* 
as held for postprogram outcomes. On-the-job training terminee ^ 
grou]^ had the largest gains in average annualized earnings and 
average percentage of time employed (+$2,300 to +$3,390 and +19 
percent to +24 percent), followed by public service employment 
terminee groups. Classroom training terminee groups were only 
slightly behind the latter. Work experience terminee groups 
were last again, with a range of earnings gains from +$730 to 
+$1,360 and an increase in average percentage of time employed 
from +6 percent to +9 percent. All changes were gains, however, 
and the changes in both measures were fairly substantial, even 
with the conservative baseline. 

Public ber^ef its , received * 

* 

Disaggregating by t}$pe of service yields frequencies too low 
to permit reliable comparisons of receipt of specific types of 
public benefits before and after CETA. Therefore, table 29 pre- 
sents only aggregate information. The same cautions apply to 
interpreting this table as apply to table 21. * 

Classroom training and work experience terminee groups, cott^ 
sistent with our earlier discusrsxoris, regarding their relatively 
disadvantaged status, had higher percentages of households « 
receiving sqme form of public benefit both' before and after CETA 
participation, ^lore than 40 percent of terminees from these serv- 
ices had been in households receiving benefits before CETA; by 
the second year after termination, the percentage had declined by 
10 to 12 points. Decreases were also observed for the two other 
groups, from 32 percent of households before to 19 percent two 
years after CETA. Receipt of Unemployment Insurance payments was 
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Table 28 



Intermediate Changes in Average Annualized Earnings and Average 
Time U H iweu ior CETA Termmees Who Participated in *ault 
Services January-Jane 1975 and Fiscal Year 1976 
^ ' by Service Type a/ 



C+r OJT WE PSE 



FY 197b 

12-month termmees 

4th quarter before entry 
to 4th quarter after 
termination 



Average annualized earnings + $2,04O +$2,770 +51.260 +52,350 
Average time employed +17% +24% +9% +=20% 



January-June 1975 
24-month termmees 

4th quarter before entry 
to 4th quarter after 
termination 



Average annualized earnings +$1,330 +$2,300 + $7*30 +$1,460 
Average time employed + 11* ^ +6% +12t 



4th quarter befbre entry 
to 8th quarter^kter 

termination 



Average annualized earnings +$2,250 +$3,390 +$H 360 + 52,720 
Average time employed +15% +21% +8% +16% 



a/Cl is* classroom training, OJT. is on-the-job training, WE is work exper- 
ience, and PSE'is public service employment. 

most frequent for. public service employment participant^ before 
CET& at 30 percent, but declined to 15 percent two years after 
th? program. Eight to 10 percent decreases in Unemployment 
Insurance participation were also evident for. termmees from • 
the other service types. 



~ Table .29 

Peicentage Distribution of 24-Month CETA Termmees Who Participated 
Services January-rfJune 1975 b> Receipt of Public Benefits 
and Unemployment Insurance and by Service Type a/ 



in Ad j 1 1 



CT 



OJT 



WE 



PSE 



One 



after 
1st 2nd 



Public benefits 
At least one 
None 

Unemployment 
Insurance 
Some 
None 



46 
54 



20 

80 * 



46 
54 



18 

82 



36 
64 



12 
88 



Year 


Year # 


Year 


Year 


Ye^ar 


Year 


be'f ore 


after 


be f 6re 


after 


bef or ? 


after 


One 


1st 


2nd 


One 


1st 


2nd 


One 


1st 


2nd 


32 


22 


19 


43 




31 


32 


24 




68- 


78 


81 


57 


60 


69 


68 . 


76 


81 


25 


X 

20 


15 


27 


26 


17 


30 


22* 


15 


75 


80 


85 


73 


74 


84 


70 


78 


85 



Source : 



Wes tat 
(Washing to 



Inc., Continuou s Longitudinal Manpower Survey , Fol low-Up Repo rt No. 3. 
ngton, dTTTI U.S. Department of Labor, January 1981), appendix D, table 27. 

a/CT is classroom training, OJT is on-the-30b training, WE is work experience, and PSE is 
" public service employment. Percentages may not add to 100 because of rounding. 
b/Respondent only. • . 
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Private sector employment ' , 

/' ■/ • 

There were large differences in the location of employment 

obtained by terminees from the four service types. Referring 

back to table 22, we can see that employed classroQm and on-the- . 

job training terminees, at 84 and .83 percent , 'were much mq>re 

likely td have found j'obs in the private sector 24 months after 

CETA th^n employed work experience or"public service employment 

terminees, at 65 and 52 percent. This postprogram pattern held 

for the two fiscal 1976 terminee groups also. 

One obvious explanation for this difference is that in- 
program subsidized work activities irjay have exposed participants 
to more opportunities 7 for regular employment in the public sector 
than did training activities. A fair number may have been re- 
tained by their employers. 

« 

A second explanation is suggested by t,he data on the location 
of pre-CETA employment. Slightly lower percentages of employed / 
terminees from 'subsidized work reported being employed in the 
private sector 12 months before CETA than terminees firom training. 
The postprogram pat-tern may, therefore, to sortie degree represent 
a continuation of the original differences in employment, location . 
Even so, f the percentages of employed classroom and on-the-job 
training terminees holding jobs in the private sector 24 months 
after CETA were close to the 12-month pre.-CETA levels, -while the 
percentages of employed work experience ahd public service employ- 
ment terminees holding private sector jo^s 24 months after CETA 
were substantially below 12-month pre -CETA levels: - 

EXPERIENCES OF SELECTED 4 "J 

DEMOGRAPHIC SUBGROUPS w *~ / 

In this section, we summarize briefly theex^er iencea of par- 
ticipants by the demographic characteristics ot gender , age, edu-. 
'cation, minority status, .economic disadvantage, and labor force V 
Attachment before. CETA. We do this with respect to annualized ) 
earnings and Jay gender for the occupational area of primary job. ■ 

Average annualized earnings of fiscal 1976 12-mbnth termi- > > 
nees for the fourth - quarter befc>re CETA entry and the fourth 
quarter- after termination are .shown in table 30, Changes in 
group averages and percentages are. also presented. As 'the table 
reveals, the changes in average annualized earnings between pre- 
CETA and post-CETA experiences varied considerably among these 
demographic groups. Mfen had large* absolute gains than women, 
younger people larger than older people, high school graduates 
larger than nongraduateg , whites larger than'blacks, and econom- 
ically disadvantaged (households below the OMB poverty level at 
the time of CETA entry) slightly larger than noneconomically dis- 
advantaged. 

I Looking only 'at gains, however, can mislead us about the % 

actual postprogram status of some terminee subgroups. For in- 



'Table ^0 

Absolute and Percentage Changed in Annualized Darnings of 12-Month CETA 
Terminees Who. Participated Jn Adult Service/ in Fiscal Year 1976 



mualized earni 



Change a/ 





LO-12 rfonths 


10-12 


/months 










at entry 


be fore /entrv 
Before/entry 


after t 


f rmina t ion 


Absolute 


Percent 


Male 


$3>5foO 


$6, 


; 

050 


' +$2,500 


x + 


70 


Fema 1 e % 


1,730 


3 


420 




1 ,690 


+ 


97 


Younger than 22 


1 ,890 


4 


320 


+ » 


2/430 


+ 129 


99—11 vpats old *r 


■ 3 ,180 


5 


360 


+ 1 


2,180 


+ 


68 


45 and older # 


2, $90 


4„ 


450 


+ 


1,460 v 


+ 


49 


8th g r ad e or , 1 e's s 


2,^20 


4, 


2O0 


+ 


1 ,390 


+ 


49 


9th- 11th grade 


2 ,}00 


3, 


880 - 


■f 


1,480 


+ 


61 


19t*K nr pou l uaI pnt 

1 ^ til CUUi V ui Clll 


2 ,£00 . 


5, 


010 


+ 


2,360 


+ 


89 


Beyond high school 


3,&Q0 


^6, 


290 


+ 


2,790 


+ 


80 


w n 1 1 e 


3,140 


-V 


570 


v + 


2,430 


+ 


78 


Black 


2,240 


• 3, 


890 » 


'+ 


1 ,650 


+ 


74 


Hispanic 


2,660 


4, 


740 


+ 


2,080 


+ 


7.8 


Other 


2,770 


4, 


970 


- + 


2,200 


\ + 


80 


Economical ly 


1,990 


4, 


240 


+ 


2,240 ' 


+ 113 


d i sadvantaged 










2,020 




51 


Not economically 


3,960 


5, 


980 


+ 


+ 


d isadvantaged 




i 


N 










During 12 months 
















before entry 














Employed 90% or more 


6,860 




710 




v 150 




2 


Unemployed 501 or more 


1,640 


4, 


300 


+ 


2,600 


+ 162 


Not in labor force 50% 


670 


4, 


300, . 


+ 


3, §30 


+ 


>4.0 


or more 
















Other " 


5,160 




000 


+ 


840 


+ 


16 


r s 

All 


2,820 


5, 


000 


+ 


2^180 


+ 


77 



Source: Westat, Inc., Continuous Long i tudinal Manpower Survey, Follow-Up 
Report No. 2 ( Washington, D.C. : U.S. Depar tment 'Of Labor, March 



1979 ) , appendix O, table 69. 



J 



a/Dollar aifterence does not always -equal the difference, between the aver- 
" ages for the comparison quarters because each was c^culated before the 
comp^ison quarter averages were rounded. 

stance, women's gain was $1,690/ a 97 percent increase* while 
men's gain was $2,500, a 70 percent increase "Eire pe^c^ntage 
change favored thfe women, but the absolute change in earnings 
favored the men, by $810* Moreover, when postprogram experiences 
of males and femal<es were compared after CETA, the difference in 
average annualized earnings £avored ,the men by 1 more than $2,500. 
*ijius , we see that it is necje^saryt to consider bpth postprogram 
earnings levels and pre-po^f. changes to understand, th£ circum- , 
stances of demographic subgroups. ' 1 

- ; ' ' S ' • / ' 
With 1 respect to -fourth quarter postprogram annualized earn- 
ings-, groups that had annualized earnings higher than $5,000 
consisted of males, people with at least a high school education, 
adults 22, to 44* years old, whites, and people not economically 
•disadvantaged* Only people who were female, with education at 
the '9th to 11th grade level A an<J black had annualized earnings 
less than $4,000. In general, th^ same ordering qf demographic 
subgroups was found for the ^average annualized earnings o£ 

•s* - 

1 
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January-June 1975- ^4-month terminees in their first and second . 
y^ars after leaving CETA^and for fiscal 1976 3-month terminees 
1 to 3 months afterward •* 

An additional , analysis was performed fbr subgroups with vary- 
ing labor force attachment in the' year before CETA participation. 
Fiscal 1976 12-montfr terminees were grouped into four categories — 
predominantly employed, predominantly unemployed, predominantly 
not in the labor force, and a residual category. The predomi- 
nantly employed in the year before CETA had average annualized 
earnings of $6,860 and $6,710 in the fourth quarter before amLu 
the fourth quwAr after CETA; this subgroup did not realize 
gains. The predominantly unemployed had, average annualized earn- 
ings of $1,640 in the fourth quarter preceding CETA; they had 
gained $2,600 by the fourth quarter afterward. People not in the 
Tabor foVce also had large gains, at $3,630, because of their ex- 
'tremely low preprogram earnings, at $670. People in the residual 
subgroup gained only $840, a function of relatively high prepro- 
gram earnings • In summai^, we can see that people who realized 
the largest gains had the poorest labor force attachment before 
CETA; they .made up more than half of th$ fiscal 1976 ' terminee 
group. The predominantly employed, the subgroup not realizing 
gains, consisted of only 14 percent of the fiscal 1976- terminees, 
as we saw in table 4. 



Data on the occupational areas of postprogram primary jobs 
for employed male and female January-June 1975 terminees are- 
given in table 31. Comparable postprogram employment data were 
not available for fiscal 1976 terminees. Approximately 10 percent 
of both male and fdmale terminees held jobs in the professional 

^ Table 31 

Lmployment Distribution of 24-Month CETA Terminees 
N Who Participated in Adult Services 
' in January-June >975 by primary Job and Gender a/ 





Male 


Femal 


Professional , technical, 


9% 


101 


and kindred 






barm' managers and laborers 


2 




Nonfarm ^» 






Managers and administrators 


6 




Laborers 


14 


» I 


Sales 


3 


2 


Clerical and kindred ' . 


6 


47 


Crafts and kindred 


22 


2 


Operatives 


23 


11 


Service workers , 


16 


22 


Tota 1 


1001 


100% 


Estimated total terminees 


146,200 


73,000 


Source: Westat, Inc. , Continuous 


Longitudinal Man- 


y Power Survey, Fol low-Up 


Refport No. 


_2 (Wash- 


ington, D.C. : U.S. Department of 


Labor , 


January 1981), p. 5-26. 







a/Percentages may not add to 100 because of rounding. 
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or technical areas 24 months after CETA; some 16 percent of males 
and 22 'percent of females held jdbs as service workers. The larg- 
est differences between* gender s occurred in clerical/ crafts, 
operative, and nonfarm laborer categori^te. Almost half of the 
women held clerical positions — traditional ly low paying — as op- 
posed to only 6 percent of the, men. S6me 45 percent of the m^n 
held jobs in crafts or as operatives, compared to only 13 percent 
of the women. Crafts and^ operative jobs normally have higher 
wages than Secretarial jobs? and therefore the difference in 
earnings for men and women after CETA may be partially the re- 
sult of the types of jobs they secured. 

Exploring differences in "occupational areas for other demo- 
graphic subgroups is difficult because the large number of cate- 
gories produce, somewhat unstable estimates. There appear to have, 
been greater percentages of people older than 45, pon-high school 
graduates , 'and blacks in service occupations. More blacks 6han 
whites held clerical jqbs . . Fewer blacks than' whites held profes- 
sional, managerial, and crafts jobs. * 

SUMMARY 

Our descriptions in this chapter are 'of the experiertees of 
parti^ipants^in the early years of CETA — January 197 5 ►to June 
1976. , Changes in CETA 1 s eligibility requirements a|nd operation 
since 1976 somewhat reduce our ability to generalize "from these 
descriptions for current participants in the program. Public ^ 
service employment is most vulnerable in this regard because its 
eligibility requirements were tightened and limits were placed 
on -wages and the nature of positions. Descriptive v^ca on the 
r^jfc&e other service types should provide reasonable guidance on 
the* program 1 s current operation. 

For the 197£ and 1976 participants, we know that they had 
a consistent pattern of declining earnings in the year preceding 
CETA— from approximately $3,000 in average annualized earnings 
in the fourth quarter preceding CETA to approximately $1,600 in 
the quarter immediately before entry. $p also know^that in the 
first quarter after CETA, their annualized earning^ increased to 
about $3,800; foe the 1975 participants, this continued to in- 
crease to the eighth quarter afterward to $5,800. Comparable 
pat£ern^4K*ld for percentage of time employed and percentage of 
people employed at selected times, indicating that the earnings 
'increases are unlikely to be solely a function of inflation.. In 
general, on earnings and employment variables immediately after 
CETA, participants were at a level matching or exceeding their 
status at the hiph point of their year before. CETA find their cir- 
cumstances continued to improve. 

Receipt of sc$ne form of public benefit by participant 
households dropped from 38 percent^an the year preceding fclETA to 
25 percent two years a:fterward. Receipt of payments from Unem- 
ployment Insurance to individuals dropped from 26 'percent to 
15 percent. * 



For employed Januaf-y-June 1975 participants, jfoV percentage 
in private sector jobs was 82 percent one year before CETA and 66 
percent two years afterward. Employed fiscal 1976 participants' 
had a greater proportion in the private sector after CETA than\ 
did the January-June 1975 group. 

In considering- the experiences of terminees from the four , ' 
servipe types, we should view £hem within the context of the 
•characteristics of people typically enrolled in, these services. 
For example, enrollees in classroom -training and work experience 
were relatively more disadvantaged than enrollees in on-the-job 
training and public service employment. 

, Participants in classroom training and work • experience gen- 
erally had poorer labor force experiences before' CETA thin par- 
ticipants in the two other services. They also had much poorer 
postprogram experiences. Classroom training and work experience 
terminees had ^1 , 000 to ?2,500 less in average annualized earn- 
ings -and approximately 5 to 20 percent less in average percentage 
of time employed jind people employed at selected times. 

With respect to changes in average annualized earningsAand 
percentage of time employed, on-the-job training participants 
had the largest gains, at $2,300 to ?3,390 and 19 to 24 percent. 
Work experience participants had the smallest gains) at ?730 to 
$l,360;and 6 to 9 percent. Classroom training and public service 
employment participants stood between the two. 

\ 

The households of the classroom training and work experience 
participants were more likely to tiaVe received some form of public 
benefit, both before and after CETA, than other groups. The per- 
centage of households receiving public benefits declined approxi- 
mately 10 to 12 points by^ the second^year after CETA ' for all 
service , types. Receipt of Unemployment insurance payments was 
highest for public service employment participants in the pre-CETA 
year-^-30 percent—and declined to 15 percent in the second year 
after the program . • 

t Employed terminees from classroom and on-the-job training 

were more likely to have found jobs in the private sector after 

CETA than employed terminees from work experience and public 
service employment. ' r 

In sum, the Continuous Longitudinal Manpower Survey provides 
us with a rich data base for describing the experiences of early 
CETA participants before and after their participation. These 
data cannot be used to address the issue of program effectiveness, 
but they are suggestive in several important ways. On the posi- 
tive side, the pre-p6st patterns for earnings, wages, employment, 
and receipt of public benefits are consistent with the goals of 
CETA to increase earnings and self-sufficiency. The fact that 
gains achieved immediately after program ^exit did not deteriorate 
one to two years later and instead showed further improvement is 



also encouraging. On the negative side, the shift in location 
of employment from the private to the public sector before and 
after CETA, particularly for participants in work experience and 
public service employment, points up the importance of -developing 
linkages between publicly funded employment and training and 
business and industry. 
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CHARTER 6 ' ' ' 

ADULT-ORIENTED CETA SERVICES— THEIR EFFECTIVENESS 

AS MEASURED- BY PARTICIPANTS' EARNINGS 

In chapters 4 and 5, we provided descriptive information on 
the experiences of participants before, during, and after par- 
ticipatirfg m adult-oriented CETA services. Here, we summarize 
information on. the effectiveness of these services with respect 
to increasing the participants' earnings. In othejF words, we 
seek to address the question of. absolute effectiveness— of 
whether benefits would have been realized without the program— 

J™« V ? ue ? tion ° f the relati ^ e effectiveness of service, 
types. We rely largely on analyses conducted by Westat on the 

S^S^?, g ii U ? ina - M&n P° wer Surve y fiscal year 19>6 sample 
of 6, 286 12-month termmees for the first year after program ter- 
mination .t in these analyses, Westat drew a match group of 5,249 
from the March 1976 Labor Force Survey of the CurrSnt Population 

?!™^iS5 "J 6 ""JUS, com P arison base, westat based estimates of 
CETA a effects on 1977 earnings on differences in" earnings cov- 
f5?f* ^^i* 1 Secur ! t y between the sample and the matched group, . 
. twesta^^^ia 0 ? J^-ally for a variety of background facto?;. 

We offer a number of caveats concerning these estimates. 
For one,- soige jobs m the public sector ar.e 4iot covered by the 

Sec " rit y system. Therefore, some individuals moving into 
public .sector jobs not covered by Social Security appear to be 
^°hJ^ n ; rS in ^ is . anal ysis. For another, the comparison group 
may have been contaminated analytically in that it may have' in- 
eluded^ ^p m -e\ people with CETA experience, although this problem 
is greatest \£6r younger age groups and minorities. 

Despite such warnings, these estimates constitute the best 

iwon^ 1 ?" ; V !i lable , at thiS time * ^ matc ^ing procedures were 
thorough, and the analyses used estimations of somev twelve dif'- * 
ferent models for gender, race, and preprogram earnings subgroups. 
While it is desirable that other researchers apply competing ana- 
lytic techniques to these data sets to assess the'sensitivity of 

I" different analytic approaches, Westat ' s approach 
appears to have been conservative and consistent with sound prac- 
. tice. m reporting the results of Westat's impact analysis, we 
concentrate almost exclusively on the 'estimates of impact that 
III ™!M ^jally significant, leaving it to the reader to judge 
the practical significance of individual findings. As with any 
complex analysis, until these estimates are confirmed for these 
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l/Appendix I gives a more detailed description of Westat's match- 
ing and analysis procedures. Inflation is not a factor in 
Westat s net impact estimates since a comparison group for =u 
comparable period was used in the analysis. * 



ily] 

® * 82 lV3 



^5- 



•or other years of data, it makes sense to concentrate on the 
general pattern of the results rather than on specific dollar 
values for service types or subgroups of participants. 

EARNINGS OVERALL AND BY SERVICE TYPE 

For participants in classroom training, on-the-job training-, 
work excK-rience, public service employment, and multiple services 
(generally some combination of work experience and training) the 
overall impact of CETA on 1977 earnings was estimated at $300. 
This amounts to a 7 percent increase over the 1977 earnings of 
the comparison group. Estimates for the service types differed 
markedly. * , , ' 

Earnings increased most $or participants in on-the-job 
training, with an increase of $850. Classroom training and mul- 
tiple services followed, each with $350. Public service, employ- 
ment was next, at. $250. Work experience was negative but not 
statistically significant, at -$150. See table 32. 



As we discussed in chapter 5, emp 
3ervice employment and work experience 
likely to be employed in the public se 
sector jobs are not covered by Social 
earnings information fo;r this report, 

earnings effects of public service 
wh^t lessex extent, of work experience 
thus, likely to be understated. Westa 
overall and public service employment 
yielded a net impact estimate of $400 
for public service employment. 

Table 32 



loyed termine 
services wer 
ctor . Bec^us 
Security, the 
it is difficu 
employment a 
Net impact 
t's attempts 
estimates for 
overall and $ 



es from public 
e the most 
e some public 

source of the 
It to estimate 
nd, to a some- 
s for them are, 
to adjust 1977 

this factor 
350 .to $750 



Estimated Net Impact of CETA on 1977 and 1978 Earnings 
of Participants in Fiscal Year 1976 Adult Services 
. ,by Service Type a/ 





CT 


OJT 


WE 


PSE 


Mu 1 t iple 


Overall 


1977 


+$350* 


+$850* 


-$150 


+$250** 


+$350*** 


+$300* 




(10) 


(18) 


(-5) 


(6) 


(10) 


(7) 


1978 b/ 


+ $450 


+ $550 


-$200 


+ $350 


+ $150 





Source: Westat, Inc., Continuous Longitudinal Manpower Survey^ 
Net Impact Report No, 1 (Washington, D.C.: U.S. De- 
partment of Labor, March 1981), p. 3-27, and R. Ta'ggart, 
A Fisherman's Guide: An Assessment of Training and 
Remediation Strategies (Kalamazoo, Mich.: W. E. Upjohn 
Institute for Employment Research, 1981), p. 57. 

a/Rounded to nearest $50.00 and not adjusted for noncoverage of 
Social Security. Numbers in parentheses are percentages of 
comparison group averages. 
[ b/Signif icance leveis not avaxiaDie. 

♦Significant at ttte 0.01 level. 
**Signif icant at the a. 05 level. 
***Signi f icant at the 0.10 level. 
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Preliminary analyses of 197^a>aings ,data indicate that 
earnings gams for participants in on-the-job training and mul- 
tiple services, contrasted ^ith the record for comparison group 
members, decreased somewhat in the second year after CETA while 
the gams of participants in classroom training and public 
service employment increased slightly. The effect for work' 
experience participants was, again, negative. (Taggart, 1981) ' 

EARNINGS FOR SELECTED ' c- 
DEMOGRAPHIC SUBGROUPS 

The effects of CETA varied considerably according to par- 
ticipant characteristics" and the type of service they Engaged * 
in. Overall, both white, and minority women realized statisti- ■ 
caiiy significant earnings gain's ranging from $500 to $600. ; 
Earnings gams for men at $200 were small antf not statistically ' 
significant. See table 33. • *«i«iiy 

y > 

nloi m l n c ° ns idered by service type, the picture is more com- 
plex. -Females profited from classroom and on-the-job traininq 
and public service employment, with large gains relative to 
comparison groups of $1,200 for minority women in on-the-job 
training and $950 for white women in public service employment. 

2 ?nn Uy ' minorit y women in multiple services realized a gain 
of $1,400. They w^ere the only group to show a statistically sig- 
nificant gam from participation, in multiple services. Meanwhile, 
white men .prof^tetf from classroom arid wn-the-job traininq. Their 
largest gam was in on-the-job training, at $750; in classroom 
training, their gain-was $400. Minority, men realized statisti- 
cally significant gains only in on-the-job training, but the net 
impact was large, at $1,150. <> 
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Impact estimates derived separately for subgroups with vary- 
ing earnings histories reveal that people with the lowest earn- 

ce?a 5!Si! 9 ! i ; ed the m ° St frora Participation. When the 

CETA sample and match group files were divided into preprogram 
earnings -subgroups, the following comparison categories were ' 
^^f^ 6 " 3, Peo P\f/ w li°se social 'security earnings|in both 1973 
and 1974 were less Yharj $2,000 and, who during interviews reported 
earnings of less than $4,000 in the preceding year were cateqo- 
f£o 6d o aS j£ Wer ea F n ? rs -" ("Preceding year" for the sample was 
the 12 months* preceding CETA enrollment, while for the match 
IJ°nSn lt WaS calendar year 1975. The -interview criterion of 

$4,000 was set in order to remove from the low earner category 

S£?i? c W -f 6 n0t ? overed b y Social Security.) People whose 
Social Security earnings in both 1973 and 1974 were $4,000 or 
more were categorized as "higher earners." People who did not 
fit into either of these categories were termed "intermediate 
and mixed earners." Table 34 presents estimates of net impacts 
for these three groups by type of service. 

r 

Low earners demonstrated statistically significant gains 
relative to their comparison group overall and for every service 



Table 33 

i 

tstimated Net Impact of CETA on 1977 Earnings of Participants 
in Fiscal Year 1976 Adult Services by Gender, Race, and Servide Type a/ 



CT 



OJT 



WE 



PSE Multiple Overall 



Male 
White 



Minority 

Fema 1 e 
White 

Minority 



+$400* 
(7) 

+ 200 
(5) 



+ 550* 
(21) 

+ 500* 

(20) 



+ $ 750* 
(14) 

1, 150* 
(29) 



+ 550* 
(20) 

+ 1, 200* 
(50) 



-$450* 
(-8) 

0 

10) 



+ 50 
(1) 

+ 300 
(12) 



* +$100 

4 (2) 

" - 50 
(-1) 



+ 950* 
,(35) 

+ 650* 
(27) 



+ $ 150 
(3) 

300 
(-8) 



+ 450 
(17) 

+ 1,40(5* 
(57) 



+ $200 
(4) 

'+ 200 
(5) 



+ 500* 
(19) 

'+ 600* 
(25) 



source : West at , Inc . , Continuous Longitudinal Manpower Survey ; Net Impact 
Report No. 1 (Washington, >D-C: U.S.- Department of Labor, March 
19810 > p. 3-27. 

a/ Rounded to nearest $50-00 and not ad3usted /or SSA noncoverage. Percent- 
ages are percent of comparison group averages. There are separate compari- 
son groups for each category of gender and race but not service types. 
The 'base for percentages by service type is the weighted CPS average for 
the gender/race comparison subgroup. Minority includes Hispanic. 



•Significant at the 0.01 level. 
**Signif leant at the 0.05, level. 
***Signif leant at the 0.10* level. 



Table 34 

Estimated Net Impact of CETA on 1977 Earnings of * Part icipants «. 
in Fiscal Year 1976 Adult Services by Preprogram Earnings Level 
and Service Type a/ 



Preprogram 
earners b/ 


CT 


OJT 


WE * 


PSE 


4 

Multiple 


Overall 


Lower 


+$600* 


+$1,300* 


$ 0 


+$900* 


+$550** 


+$550* 


Intermediate 
and mixed 


0 


+ ^50* 


- 200 


0 


+ 250 


' + 50 


Higher 


\+ 250 


+ 300 


- 800*** 


- 2^0 


+ 100 


- 50 


Source: Westat, Inc., 


Continuous 


Longitudinal Manpower 


Survey: 


Net Impact 



1981), p. 3-29. 



March 



a/Rounded to nearest $50.00 and not adjusted for SSA noncoverage. 
b/ Lower earners had less than $2,000 in Social Security reported ^earnings 
~" in both 1973 and 1974 and in interviews reported less than $4,000 in the 
year before program entry. Higher earners had $4,000 or more *n Social 
Security reported earnings in both 1973 and 1974. Intermediate and mixed. 
earners did not meet either set of criteria for lower or higher earners. 

♦Significant at the 0.01 level. * 
♦♦Significant at the 0.05 level. 4 
***Significant at the 0.10 level. 
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type but w&rk experience . intermediate ^nd /ixed earners real- 
ized statistically significant gains only*J:or on-the-job training - . 
High earners actually appeared to lose ground by participating in 
york e-xperienpe. The high earners, the group with the most dis- 
couraging results, represented only 15 percent of the fiscal 1976 
participant sample, however,^ while the group with the best re- ; 
suits, the lpw< earaenfl^ constituted some 50 percent v of thd sample^ 

Estimates of net impacts by age*were not particularly -en- 
lightening . People 17^years and older had large and statisti- 
cally significant gains in on%the--job training — mores than $700. 
In the other service types? sucft^g^ijis were few and widely scat- . 
-tered. People aged 30 to 44 had a $1,000 gain from classroom 
training,* however-, and^people 19-21, 26-29, and 45 and older real- 
ized statistically significant ^gains from participating in public 
service employment. People who realized gains from multiple 
services were aged 22-25, or were older than 45- The scattering 
of statistically significant gains, the small number of cages >n 
some age and service groups, and the confusing pattern of dif- 
ferent' results for adjacent age groups makes these estimates 
somewhat suspect. „ ^ 

« One addition*! analysis warrants attention. As expected, 
longer lengths of stay in classroom and on-the-job training and 
in public service employment were associated with larger net im- 
pacts. The most dramatic of these effects was found for class- 
room training, in which the net impact for 11 to 20 weeks was 
$300 but jumped to $1,600 for a stay longer than 40 weeks. For 
.on-the-jbb training this~ relationship held only up to 40 weeks, 
but /trends were also evident overall and for multiple services. 
ThirsWelationship^s .suggestive but probably reflects some degree 
of /election bi>su "Length of stay" is likely to be influenced 
by factors not necessarily captured in this analysis, such as 
individual motivation , occupational area of training, and atti- 5 
tudes of the service deliverer. Therefore, modifying CETA to 
encourage longer stays may not yield improvements in net earnings 
gains commensurate with these estimates . 

CHANGES ' IN EARNINGS 

The analyses we have described reduced program impacts 4 to 
a single number for each subgroup — that is, to an estimated net 
impact on earnings. Only through such an approach could adjust- 
ments be attempted for the nonequivalences that remained between 
the sample and the comparison groups . This approach- tells us 
little about the distribution of earnings changes within the 
groups, vhowever. Perhaps CETA is effective only for a small 
proportion of participants but accomplishes a lot for those 
few. Some proportion of CETA participants could h^ve achieved 
large earnings ^gains relative to a comparison group even in the 
absence of a significant aggregate net impact. 

To investigate thistfrtfssibility , we studied distributions 
of gross earnings changes based on 1974 and 1977 Social Security 
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earnings records for both the CLMS /sample and the comparison 
groups from Current Population Survey (CPS). To avoid the pre- 
program dip in earnings characteristic of CETA participants , we 
used 1974 as the base year. These 'earnings change distributions 
must be interpreted with caution. They are intended to complement 
the.net impact estimates, not to compete with them; The contrasts 
of earnings change!? for the sample and the comparison groups rely 
solely on tfr^ matching procedures to' equate the groups. We made 
no attempt to adjust for remaining differences in background 
factors, nor have earnings changes been adjusted for inflation. 

In the figures that follow, we present distributions only 
for the entire CETA group ancl for subgroups that h^d clo.se ly 
matched CPS comparison groups — that vis, race and gender subgroups 
and preprogram earnings subgroups. We used weighted cases for^ 
the CPS distributions according to the sane procedures followed 
in the net impact analyses. Figure 5 shows distributions of 
gross changes in earnings for the entire CLMS sample and the 
matched .CPS comparison group. The two distributions are almost 
identical. Only a slightly higher proportion of CETA participants 
(2-4.5 percent) ,gained $4,000 or more over the three-year period 
than the comparison group (21.3 percent). 

Distributions of gross earnings changes for minority and 
white males and' females are presented in figures 6 through 9. * 
They show that there was little difference between the distri- 
butions of CETA minority and white males and their comparison 



Figure 5 

Gross Changes in Social Security Earnings of CETA Participants 
and CPS Comparison Group 1974 77 
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Loss 52000 + 

$1000 1999 
$0 999 

Gain $1-999 

$1000 1999 
$2000-2999 
$3000-3999 
$4000-4999 
$5000-5999 
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"Figure 6 

Gross Changes in Social Security Earnings of Minority Males 
Vn CETA and CPS Comparison Group 1974-77 



Change . 
Loss $2000 - 
^ $1000 1999 
$0 999 
Gem $1 999 

$1000 1999 
$2000 2999 
$3000 3999 
A $4000-4999 
$5000 5999 

S 

$6000- 




Percent 

11 5 
13.5 
5.1 
6 1 
20.1 
17 1 



14 8 
12.1 
82 
11.5 
8 9 
8 4 
. 72 

6 3 
5.8 
5 5 
4 2 
12.4 
14.1 



i ; 1 1 
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Figure 8 

Gross Changes in Social Security Earnings of Minority Fema 
* in CETA and CPS Comparison Group 1974 77 
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Change 

Loss $2000 « 

$1000 1999 
$0 999 

Gain $1 999 

$1000 1999 
$2000 2999 
$3000 3999 
$4000 4999 
$5000 5999 

$6000* 



CPS 
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79 
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Figure 7 

Gross Changes in Social Security Earnings 6i White Males 
in CETA and CPS Comparison Group 1974-77 
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Gross Changes m Social Security Earnings of White females 
in CETA and CPS Comparison Group 1974-77 
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Figure 10 

Gross Changes in Social Security Earnings of Low Earners in CETA 
Preprogram Earnings Group and CPS Comparison Group 1974-77 
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Figure 11 

Gross Changes in Social Security Earnings of Intermediate or Mixed Earners in CETA 
Preprogram Earnings Group and CPS Comparison Group 1974-77 
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Figure 12 

Gross Changes in Social Security Earnings of High Earners in CETA 
Preprogram Earnings Group and CPS Comparison Group.1974-77 
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in°c??A ( h f ir^ S 7 ) but > at b ° th min ority and white females 

' iJL * had earnings change distributions slightly more skewed to 

For whiL S ip%^ an ^ 6ir Com P arison groups figures 8 and 9? ° 
For white females, almost 6 percent more of the CETA participants 

than S4 e 000 CPS Fo° mPariSO ? ^° UP had ** ins ^ to o/ r f" 
Jn%«£U 2\* * minorit y females, the difference was 8 percent 
in fa.vor of the CETA participants. p ^ 

+ -r 1 ->,„I^ gUre ^ 10 ' U ' and 12 P resent gr°ss earnings change dis- - 
eSrne^anf^r* ° PS i° W ' ea ^rs, intermediate a^d m xed 

^ A h 9h earners ' °"ly the CETA low earner subgroup 

end of S . + ial i y high6r P ercenta ge of individual's at ?he gain 
end of the distribution than its comparison group. Of the CETA 
low earner subgroup, 27 percent had earningsVns of $4,OoS or 
more/ compared to the 20 percent of the CPS group. J 

femal^ e a n^S renCeS " 9r ° SS earnrn gs cna nge distributions for 
females and low earners as 4 against their comparison groups are 
consistent with the net impact estimates forthese g?o3p?? %J 
net lffl pact estimates for minority females, white female?, and low 

£ llll ar ^f atl 4 tiCally si g nifica "t.but rather small-on™ $500 
to $600. .The differences in the proportions of these groups and 
their comparison groups experiencing earnings gains of $4,000 or 
more suggest that while CETA's effect may bJ small whenTaisessed 

r1anzed Pa ubstaSt?arb:nrfi?s: tiCipa ^ tS ^ none ^^le^have 

Countering this positive note, however, is the fact that 
. some 36 percent of the CETA participants had no gains or nad 
lower earnings in 1977 than in 1974, a decline that would have 

(Note^hat^f r ^ """"lings bee » adjusted for inflation. 
IZtl that the seeming decline may result^ W part , from some of 

'r^ P r P !. haVing mOV6d int ° J° bs not.cov^ed by Social Secu- 
An 3vtn if inCOmeS bnerefore unreported in the current study.) 
An even larger percentage-41 percent-of the-comparison group 
also experienced either a decline in earnings or no gains? The 
percentage of CETA participants who lost earnings over three 
fl^L 13 n0t enc ouraging for a program that was intended to # 

increased earnings and self-sufficiency, but it must be 
viewed, in the context of the even larger percentaae of mmna H^ 
group members who did likewise. Percentage of comparison^ 

SUMMARY ' 

aram fo?? ram P art icipation in fiscal year 1976 raised postpro- 
gram 1977 earnings by an estimated $300 to $400 over what ihev 
would have been otherwisk-a 7 percent increase over the earnings 

Hants' T?77 1S r 9rOUP - ^°" lY a Sma11 Proportion of CETA parti? 
cipants 1977 earnings can be attributed to the program. 

On-the-job training had by far the largest impact ($850) on 
1977 earnings; this was followed by classroom training and multi- 
ple services (both $350) and by public service empJoymen? $250 
or from $350 to^SO if adjusted for Social Security^oncoverage . 
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No significant positive effect was found for work experience. 
Preliminary analyses of 1978 earnings indicate some reductxon in 
gains for on-the-job training and multiple services during the 
second postprogram year with small increases for classroom train- 
ing and- public service employment. 



Statistically significant gains were experienced by wome 
both minority and -white, and by other people who had had poor 
pre-CETA earnings. Women participating in CETA gained approxi- 
mately $500 to $600>ore than their comparison groups. Men 
gained $200, not statistically significant. People with poor . 
pre-CETA earnings histories— 50 percent of the fiscal 1976 par- ^ 
ti'cipants— gained some $550 more than their comparison group ^ 
/counterparts. Individuals with mixed or higher earnings patr- 
tern's before CETA generally did not realize statistically sig- 
nificant gains in earnings. 

Distributions of earnings changes from 1974 to 1977 show a 
higher frequency of gains over $4,000 for the same groups indi- 
cated in the net impact analyses—white and minority women and 
people with the poorest pre-CETA earnings histories,. These dis- 
tributions suggest that while the aggregate data on CETA s impact 
show only a small impact "6n .earnings, some percentage of .those 
qroups may 'have realized substantial gains. In interpreting 

* these results, we must remember that the best estimates we have, 
of CETA's effects are based on a single analysis approach and a 
single criterion— earnings ? The degree ijo which these estimates . 
are sensitive to the kinds of analytic methods that were used is 
unclear. Additionally, we do not have^in format ion on CETA s . 
effects with respect "to the other kinds of evaluation criteria 

. we discussed in -chapter 3. For>hese reasons-,- attention should 
be focused not on specific dollar values but on the general 
pattern of results from this analysis, 

' i V 
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CHAPTER 7 



THE PRIVATE SECTOR INITIATIVE PROGRAM — 

. . CETA TITLE VII 

The Private Sector Initiative Program (PSIP) was announced 
in 1978 by .President Carter in his State of the Union message to 
the Congress. He described it as a $400 million effort to mobil- 
ize the private sector to assist in tra/ining and hiring the "hard 
core" unemployed. In this chapter, we /describe what is known so 
far about PSlP's operation and outcomes. - 

» 7 * 

When PSlp|was established, several justifications were of- 
fered for it. First, it was -argued (£frat since a(T percent of all 
new jobs are in the private sector, business anff industry should 
participate in Federal employment and- training programs. -'Second, 
critics oKthe rapid growth of public/service employment programs 
urged that J£ETA be refocused to emphaJfeiz^e private' sector jobs. 
Third, PSIP was called an inst itutiorf-building mechanism, one 
that woulcKprovide intermediaries between the private and the 
public sectors. ' 

The Comprehensive Employment and Training Act Amendments 
of 1978 (Pub. L. No. 95-524) state two -purposes* for PSIP. It is 
to demonstrate the effectiveness of a variety of ways of increase 
ing the involvement of the business community .in-CETA' activities, 
and of irtcreasing private sector . employment* opportunities f6r ' 1 
,people who are unemployed .or underemployed and alsb economically 
disadvantage^. The organizational vehicle for title VII activi- 
ties is made up of Private Industry Councils. They are the in- 
termediaries between the two Sectors . 



mus 



^A majority of the members of the Private Industry Councils 
tribe representatives of local business and industry. Addi- 
tion al r epresentation is required from labor, education agencies, 
andycT5mnHMii ty-based organizations* The Councils may operate in 
conjunction with a single prime sponsor or may assume tib£e~\ftl 
responsibilities for several prime spons ors. They are t<p design 
the private sector portion "of the prime" sponsors 1 annual \pla-rfs 
and Coordinate with other Federal programs, such as those of the 
Economic Development Administration, and they can, administer and 
operate their own employment and training programs directly or 
by contract. Their funding is channeled through prime sponsors. 

PSIP can provide on-the-job training, classroom training// 
apprenticeship programs, job readiness classes, upgrading, arid 
small-business intern programs* Participants in direct employ- 
ment and training, activities under PSIP are subject to the same 
Eligibility requirements as hold for Comprehensive Services 
):itle IIB-C. PSIP can also -provide support in the form of in- 
formation (for* instance, publicity about 'the Targeted Jobs Tax 
Credit program), labor market forecasts, assistance to employers 
trying to reduce administrative burdens, model contract develop- 
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ment, follOwup studies of program participants, and coordination 
with other programs. v 

PSIP began by/adminis trat ive directive in May 1978. Each of 
34 pilot sites received $25,000 to set up Private Industry Coun- 
cils and prdvide them with support staff. PSIP was mandated 
under title VII ofCETA's 1978 reauthorization,, but because CETA 
,was held under a ftontiJnuing resolution, PSIP's startup was , 
delayed. Each prime >6pQjfisor received a $25,000 allocation for 
planning in December 1978, but 4 the final regulations were not 
published until April 1979 and further allocations' for title VII 
did not become available, until the following June . Prime spon- 
sors were then'told to establish Councils by the end of 1979 and, 
indeed, in June 'l979* DOL announced that 164 Councils had already 
been established. - By Augu-st 1979 , the number had grown -to 310, 
and by February 1980 there were 447.* 

The two major issues in assessing PSIP are whether the 
Councils are doing anything different from what prime sponsors 
have done in the past and whether they are ^n effective mechanism 
for moving economically disadvantaged people into unsubsidized 
private sector jobs. Since its existence has been. so brief, it 
is still too early to measure with an# certainty how effective 
PSIP is. Its first year was largely a time of insti tut ion build- 
ing . f -The 1 lfri.te^x' information available about the program is 
largely in the form of case studies and prime sponsor reports 
to DOL. Title VII activities have recently been included in the 
Continuous Longitudinal Manpower Survey, but detailed information 
on participant characteristics is unlikely to be x available in 
time for the debate on new or revised employment and training, 
leg islation . 

There are two sets of easels tudies on PSIP, one by the 
Mershon Center of Ohio Stste University (funded by DOL), and 'one 
by-the Corporation for Public/Private Ventures (CP/PV), and both 
used field observers periodically to interview local CETA and 
Council personnel. The studies conducted by the Mershon Center 
cover 25 prime sponsors across ^the country but may overemphasize 
the p^gress of .the Councils because they include a dispropor- 
tionate number of the original pilot sites. (Ohio State Univer- 
sity, 1979a, b, 1980a, b, 1981a, b) The CP/PV set of studies covers 
12 "(later 17) prime sponsors but is biased toward 4 urban areas 
and the Northeast. ( Making the Connections , 198a) 

According to the Mershon reports, in May 1979 little atten- 
tion had been given to developing specific program activities 
but 14 of 25 sites had formed Councils. Half of the Councils 
were judged to have a high degree of autonomy, but /tensions be- 
tween Councils and prime sponsors were reported at a few sites. 
By June 1980, Councils had been formed at^-all sites. Four of 
every five had at least one operational program, at least two 
thirds of which consisted of skills training or on-the-job 
trauiihg or some combination of the two. At the end of 1980, 
operations had begun in all but one site, yet observers judged 



fewer than half of the Councils as^h^ing^Traai^signi f icant 
progress beyond institution building. 

The CP/PV ^reports emphasize the evolving nature of the 
Cou-ncils, noting that they have yet to e/thblish themselves as 
independent entities in the employment and training network. 
CP/PV found the programs to be an extension of past CETA, prac- 
tices rather than exemplars of any new program concept. Activi- 
ties that generate employment (primarily marketing) represented 
only 10 percent of title VIP expenditures, even though up to 30 
percent could be so used. Fewer than half of the" Councils were 
involved in^economic development activities. 

•Other observers of PSIP estimate that at the end of 1986 
only 10 percent of the Councils nationwide were actively involved 
in directing employment and training efforts in -their communities. 
Only about 5 percent were estimated* to have extended* their in- 
volvement beypnd title VII activities. One p^ir of observers 
pu,t it in perspective this wayT "The typical . . . [Private In- 
dustry Council] member appeared fb be a manager of a firm's local 
plant, or 'the owner of a small * business such as an automobile 
dealership; few are* corporate presidents or chief executive offi- 
cers of major local firms."! (Levitan and Belous, 1981, pp. 16-17) 

In table 35, we present percentages of* fiscal 1980 partici- 
pants in various services under PSIP title VII and Comprehensive 
Servi/Ses title IIB-C. The table shows that enrollees in PSIP 
were much more likely than those in Comprehensive Services to be 
exposed to classroom occupational skills training or on-the-job 
training. These contrasts are s somewhat limited in usefulness, 
however, since the reporting categor ies^are finite and may camou- 
flage any of PSIP's innovative appro^<5neS 

j Table 35 

Lnrollees in Comprehensive services and PSIP Titles 
in Fiscal Vear 1980 by Service Type 



• Comprehensive 

Services PSIP 

_ „ _ Title IIB-C TiMe VII 

Classroom *■ raining 

* Occupational skills 34% 47% 

Otfcer . 14 20 

on-i-he-job trainmg v 13 ' 29 

Work experience 

In school 19 less 'han 1 

Other , * 21 4 

Public service employment, less than 1 less than 1 
career/employment experience , 



ERIC 



and t rfans 1 tion services 
To'al participant \^ 1,031,907 57,713 

Source: tmploymenr and Training Administration, CETA Program 
S Status and Financial Summary--Fiscal Year~1980 (Wash- 

ington, t>.C: U.S. Department of Labor, 1980), pp. • 
1931 and 3220. / 
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The difference in the number of people served under the two 
titles should also be noted* 'In 1980, more than a million people 
participated in Comprehensive Services, while the corresponding 
total for PSIP is just: under 58,000. Developing classroom and 
on-the-job training . opportunities is understandably easier on a 
small scale than on a large one. Therefore, it 'is doubtful that^y * 
PSIP could maintain its aurrent mix of services, especially its 
emphasis on on-the-job training., if it were substantially ex- 
panded. There is also some risk that the Councils may be compet- 
ing with prime sponsors for such private sector training oppor- 
tunities in the future . 

In general, the characteristics of the people served under 
all the CETA titles we have discussed in this report — PSIP, Com- 
prehensive Services, and PSE — were mote similar than different. 
This can be seen in ta^le 36. The prof iles tof PSIP enrollees 



Table 36 



Characteristics at Entry of Enrollees in Comprehensive Services, PSL, 
and PSIP Titles in Fiscal Year 1980 



Comprehensive Public Service Employment^ 

Services Count erst ructura 1 Countercycl ica 1 PSIP 
Title IIB-C Title IIP _ Title VI „J[i_t le VII 



Male 

14-19 years old 

20-44 "" 

45 and older t 

School dropout 
Student in high school 

or less 
High school graduate 
High school plus 

Receiving public 
assistance 

OMB poverty level 
or 70% LLSIL 

Single parent 
Parent in 2-parent 

t fami iy 
Other family member 
Not a dependent 

Minor ity 

Limited English 

Handicapped 

Offender 

Displaced homemaker 

Labor force status 
In school 
Underemployed 
Unemployed 

Other labor status » 



47% 

35 
58 
6 

29 
19 

38 
13 

27 



95 

18 
15 

34 
33 

50 



17 



73 



50% 

13 
75 
13 

30 
3 

45 
22 

28 

90 

21 
22 

22 
35 

50 

5 



87 
11 



55% 

12 
75 
13 

28 

3 

43 
26 

22 

80 

18 
25 

23 
35 

49 

5 

5 

6 



90 



57% 

20 
7S 



30 
5 

48 
17 

21 

94 

20 
19 

19 
42 

51 

6 

7 



83 
10 



Source : 



Employment and Training Administration, CETA Program Status and Financia l 
Summary — Fiscal Year 1980 (Washington, D.C.: U.S* Department of Labor, 
1980), pp. 4690, 6674, 7748, and 9270, 
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Table 37 * 1 

Status of Terminees for Comprehensive Services, ' PS E, and PSIP Titles in Fiscal ^>r 19*0 

Public Service Employmen t 



Comprehensive 

Services Counter structural Counter eye Ileal 
Title IIB-C Title up Title VI 



Positive a/ 

Entered~unsubsidised 37| 

Employment jl 

Public ?H) 

Private ^ (26) 

Transfers ^ 9 

Other * 22 

« Total positive 68 

Nonposit Lve b/ 32 



11% 

( 19) 
( 12) 

12 

JJ 

51 

49 



30% 

(19) 
(U) 
'12 

J2 

50 
50 



\ 



PS I P 
Title VII 



->2% 

(8) 
(34) 
11 
13 

66 

34 



Source : 



Employment and Training Administration, CETA Program s tatus and Financial 

a/ unsubs dized employment was financed by funds other than provided under CF.TA . Trans- 
fers wrre to programs under another CETA annual plan subpart operated by th" saraf^ 
prime sponsor, other positive status participants continued or entere* full time in 
elementary, secon^ry, or post-secondary academi.e or vocational school entered an 
employment and training program not funded under CETA, entered a program funded by 
SZL "^ operated by the same prime sponsor, or completed a program whose objec- 
tives did not involve entrance into unsubsidized employment. 

b/ Nonpositive status participant, left the program for reasons other than those listed 
t~°flt'J 33 ref " 81n *" suitable unsubsidized employment, being unsuccessful with 30b 
referrals, or reaching enrollment duration limits or public service employment earn- 
ings ceilings and terminating without being placed in unsubsidized employment or 
entering school or another program not funded by CETA/ 
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were nevertheless closer to those of enrollees in .title VI PSE 
than Comprehensive Services. Like title VI PSE enrollees, PSIP 
participants were more likely to be male (57 versus 47 percent) 
aged 22-44 (75 versus 58 percent), and high, school graduates 
(65 versus 51 percent) than were Comprehensive Services enroll- 
ees. This may be partly because of 'the 19 percent "-student en- 
rollment in Comprehensive Services. PSIP enrollees were less 
likely to be in households receiving public assistance benefits 
than Comprehensive Services enrollees (21 versus 27 percent). 
This provides some evidence that nationally PSIP is serving a 
less disadvantaged clientele than Comprehensive Services. 

The only cftka available on PSIP outcomes are from prime 
sponsor reports on the status of participants at termination. " 
Table 37 summarizes the fiscal 1980 reports. Both PSIP and the 
Comprehensive Services titles are seen to have had higher percent- 
ages of positive terminees (66 to 68 percent) and higher percent- 
ages of terminees entering unsubsidized employment (37 to 42 per- 
cent) than the Public Service Employment titles (approximately 50 
percent positive terminations and 30 percent entering employment). 
In addition, the private sector placement rate was highest for 
PSIP, at 34 percent, followed by Comprehensive Services at 26 
percent and PSE at 11 to 12 percent, ind icating $ome superiority 
for PSIP in terms of its ability to move the disadvantaged into 
jobs in the private sector. It is unknown whether this superior- 
ity would persist if students could be removed from the Comprehen- 
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sive Services termination data cop-i'f the characteristics of 
participants were more closely matchej. 

To summarize what we Know of PSIP*Hrj£je VII, we may say 
that throughout its first yeaT Of operation," fiscal 1980, it was 
largely institution building, forming Private; Industry Councils, 
and hiring staff. Data on its operations are^thus too recent for 
evaluating its effectiveness. The limited data "from DOL and the 
case studies show that employment apd training services . admin- • 
istered by the Councils are roughly the same types of service - 
administered by prime sponsors in the past and that they differ 
only in proportions. 

Differences 'between the characteristics of PSIP, Comprehen- 
. sive Services , and PSE participants suggest some "creaming" in 
operating the program -in t%t PSIP enrollees are somewhat less 
disadvantaged than others Vty PS&P had a slightly higher percentage 
of terminees (42 percent) entering unsubsidized employment when 
they left CETA than did Comprehensive Services (37 percent), and. 
8 percent more PSIP terminees entered employment in the private 
sector. Although the termination data Indicate a relative superi- 
ority of PSIP over the Comprehensive Services title, these data 
should be viewed in the context of th* small, size of PSIP, the- 
student enrollment in the Comprehensive Services title, the l'ess^ 
disadvantaged jrifefile of PSIP participants, and the questionable • ~ 
valueof termination data for assessing program effectiveness, as 
we discussed in chapter 3. ■ 
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CHAPTER 8 



MACROECONOMIC ISSUES 
»« ^ AND FISCAL SUBSTITUTION 



UNDE R PSE v 

1 

7t 



We have discussed CETA's performance from the participant 
perspective. Here, we look at the program in broad context , 'dis- 
cussing the macroeconomic issues associated with the evaluation of 
federally sponsored employment and training programs. The com- 
plexity of the U.S. economy and the lack of consensus among econ- 
omists on the theoretical constructs to use in evaluation, however 
militate against the development of precise estimates of the macro- 
economic effects of subsidizing jobs and sponsoring training. 
Therefore, we simply outline the major issues and concentrate on 
the single issue of substitution and displacement in job creation 
programs. We concentrate on the issue of substitution and dis- 
placement because it is central to the initial economic effects of 
countercyclical employment programs such as those operated under 
CETA title VI, or PSE. It has been argued by some that local gov- 
ernments simply substitute Federal funds for local funds in their 
areas, thereby limiting the net addition to public payrolls. 



MACROECONOMIC ISSUES 



The different titles, of CETA were designed to address dif- 
ferent problems. Some programs — the training and work experi- 
ence programs— were designed to improve the skills of the unem- 
ployed or underemployed sd\that they could better meet the 
demands of the labor market and ameliorate structural unemploy- 
ment problems, other CETA programs were designed to help solve 
recessionary unemployment problems by providing funds to pay 
wages and overhead in employing people thrown out of work by de- 
creases in economic activity. 

Regarding counterrecessionary stimulation, the debate usu- 
ally centers on whether the Federal government should reduce 
taxes* accelerate spending, or increase funding for direct job 
creation. What emerges most often from such debate is a move to 
provide increased funding for some- of each of the programs under 
consideration. This happened in the 1970 's. The economic stimu- 
lus program included Anti-Recessionary Fiscal Assistance for" State 
and local governments, the Local Public Works Act to provide State 
and local governments with funds to speed up or initiate new pub- 
lic construction and rehabilitation projects, and Public Service 
Employment mojaey through title VI of CETA to provide State and 
local governments with funds for hiring people put out of work by 
economic slowdown. 1 

With respect- to statural unemployment-, once a debate has 
been resolved on whether to provide money for training and re- 
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training programs, there being «few other choices in addressing 
structural unemployment probleiftl, discussion centers on what 
types of program to fund and which populations to target* Ideal- 
ly, training programs assist the people who are most disadvan- 
taged in obtaining positions in the labor market* That is, they 
should improve the match between labor demand and labor' supply 
and, at the same time, minimize any possibly inflationary conse- 
quences of doing so* If these programs function ideally, they 
should be able to improve the trade-off between unemployment and 
the rate of change in wages* This effect, if present, is not 
captured in the econometric models, except possibly in the long 
run.^(Ulman, 1976) Moreover, the appropriate data for assessing 
the /effectiveness of. training programs are at the individual par- 
ticipant level. That this is so seems evident from .our discussion 
in the earlier chapters* of this report. * 

Fiscalist and monetarist views 

To create a context for discussing fiscal substitution , it 
is necessary to step back slightly from the specific case of CETA 
and take a look at some of the broad issues in economic policy < 
from which programs like PSE arise. Although theoretical and pol- 
icy differences between fiscalists and monetarists have been pres- 
ent for* decades, the debate sharpened during the 1970' s, which 
were a time of large and frequent changes in the prices of food, 
commodities, metals, and oil, among other things. "Stagflation" 
— rising unemployment coupled with rising inflation — was observed 
and defined. Economists were of divided opinion about both what 
caused stagflation and how to seek solutions to it. With respect 
to structural unemployment problems, there was less disagreement. 
Virtually the entire economics profession acknowledged the need 
to train people to meet the demands of the labor market. 

*» 

Some economists, fiscal policy advocates, held that demand 
management, by spending governrififit money, changing the tax laws, 
and making some minor adjustments in aggregate monetary supply, 
could be used as an appropriate means of "fine tuning" the econo- 
my to the desired level of unemployment^ and inflation. (Blinder 
arid Solow, 1974) The central component of this model is the 
Phillips curve, which represents a relation between the rate of 
changes in wages (or, in some applications, prices) and the 
unemployment rate* Adherents of the model believe that this re- 
lation is basically inverse, so that as wages (and prices) go up 
the .unemployment rate goes down, especially in the short tun. 
(Tobin, 1980) 

Critics 'of this model, primarily monetarists, asserted 
that the trade-off envisioned with the Phillips curve is largely 
an illusion with, at best, some short-run relevance. According 
to monetarists, the key to keeping the economy growing in real 
terms with appropriate levels of unemployment and inflation is 
predictable and stable growth in the money supply. (Friedfoan, 
1971) _ „ ^ _ • 
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In simplified form; this disagreement between the two schools 
of thought can be summarized by saying that the monetarists argue 
that, introducing Federal debt-financed programs into the economy, 
like those for employment and training, cannot be stimulative in 
the long run. This is so, they say, in distinction to the fiscal 
policy advocated, because when the Federal government enters the 
money market to borrow money to finance a program, it "crowds out" 
other borrowers—or raises the interest rate — and the net effect 
of the supposed stimulus is zero. That> is, Federal spending dis- 
places private spending dollar for dollar. This debate contin- 
ues without resolution. 

Using a model structured along fiscalist lines in 1975, the 
Congressional Budget Office set forth the first estimates of the 
expected employment effects of various fiscal measures—tax chan- 
ges, tax cuts, increases in government spending, and so on. (For 
the CBO estimate^, see Temporary Measures , 1975.) These results 
were widely publicized. Shortly thereafter, new programs were 
implemented and extended, including the CETA Public Service Em- 
ployment titles, with the general expectation that employment 
creation would actually be somewhat in line with the effects 
predicted by the model. 

Public service emplqyment, or direct job creation, was thus 
offered as a speedy method of achieving two fundamental gojals — 
increasing employment levels among people who had been thrown out 
of work by recession and pushing disposable income into the econ- 
omy to stimulate aggregate demand. Secondary objectives included 
decreasing dependence 4 on welfare and other transfer programs for 
those out of work, increasing public serviced provided by those 
employed under the program, easing State andf local tax burdens by 
increasing taxes (paid on the PSE wages), and decreasing State 
and local expenditures for meeting the needs of the newly unem- 
ployed. (Okun, 1976) in other words, the basic goals were coun- 
tercyclical, intended to counter increases in unemployment that 
accompany slowdowns in the economy's growth rate. 

Methods of estimating the effects 
of countercyclical programs 

Once a countercyclical spending decision has been made by 
the Federal government, attempts are made to measure the employ- 
ment and ^income effects. How many new jobs can be directly added 
to U.S. public payrolls depends primarily on the limits that are 
placed on how long' specific wages can be paid for the positions 
and the degree of fiscal substitution at the State and local lev- 
els. Thus, we have essentially two ways in which we can gather 
information on the aggregate effects of programs like PSE. We 
can use econometric models to estimate effects over time or we 
can count and monitor the jobs and the people after a program 
has been implemented • & 

The major strength of~econometric models is that' they can 
provide estimates of effects quickly and cheaply if appropriate 
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data sets are available. This is so to the extent that the 
relationships 4 underlying the models truly represent structural 
relationships within the economy. As we have pointed out, 
however, these changed dramatically over the last* decade. A 
more basic criticism of econometric models is that they were 
built by fiscalists and, therefore, say the monetarists, they 
are accurate forecasters only to the extent that history can be 
counted on to guide future behavior. 

One important strength of the monitoring approach is that it 
can provide a rich and timely picture of local budgetary response 
to PSE stimulation; it .can also separate out from "real" substi- 
tution jobs that would have been dropped from local pay^lls'in 
the absence of Federal PSE' funds. One important problem with the 
monitoring approach is that it relies heavily on the judgments of 
informed observers but has no ability to test the £*e/iability of 
those judgments. J 

Additionally, measuring the efficacy -of employment and train- 
ing programs is complicated by their inflationary consequences. 
Ideally, such programs sh6uld lower the unemployment rate or in- 
crease the number of people who are employed without raising the 
rat^e of wage inflation. Economists sometimes refer to the rate 
of unemployment at which additional job stimulus would be infla- 
tionary as the "nonaccelerating inflation rate of unemployment"; 
it is currently estimated to be somewhere around 6 percent. 
Whether or not a program like PSE stimulates the labor market in 
a way that is inflationary depends to a great extent, however, on 
how stringently eligibility is determined for the program. (Baily 
and Tobin, 1978) 

The criteria of efficiency, equity, 
and stability ~ 

i 

Specific regulations for employment and training programs 
generally try to insure that the workers who, are employed under 
them are workers who are not in short supply and who thus have 
not been contributing to inflation by pushing up wages (they are, 
in other words, on a relatively "flat" Phillips curve).- Workers 
selected for jobs must be workers for whom supply and demand have 
little to do with economywj.de inflation. Subsidies must be given* 
not to occupational categories for which workers are scarce — to 
computer systems analysts, for example — but to categories attrac- 
ting more workers than current demand calls for — usually jobs 
requiring low skills. (Baily and Tobin,' 1977) 

Economists Who advocate selective employment policies offer 
three arguments for their preference, summarized as the effici- 
ency, equity, and stability arguments. The efficiency argument 
centers on the notion that selective employment is more effective 
than other fiscal tools to the extent that it generates larger 
changes in overall employment jper dollar of expenditure. The 
equity argument generally states that even if selective employ- * 
ment does not provide more employment per dollar of expenditure. 
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its selectivity concentrates employment opportunities on the most 
disadvantaged groups within society and this is more equitable 
and therefore desirable. The various provisions of the CETA 
legislation and its regulations targeting jobs and training on 
the economically disadvantaged follow from this ling, of thought. 
Finally, the stability argument says that offering jobs to work- 
ers with lower skills who are in abundant supply is lesp infla- 
tionary (all else beihg equal) than offering jobs to highly 
skilled workers who are in short supply. (Temporary Measures, 
1975 ; Solow, 1980) 

Reviewing the evidence coming from current research on the&e' 
arguments, Solow has concluded that the research does not really 
tell us very mucli . He offers three reasons why we do not have 
clear evidence on these points. (1) The programs are still too 
young and too small to enable us to analyze confidently their ef- 
fects on the economy as a whole. (2) Our econometric -model s are 
not able to isolate the effects of the employment programs among 
the great many other major economic changes during the same time 
period. (3) We do not have consensus on the way modern labor mar- 
kets work, especially in reference to the relation between high 
skill and low skill markets and the way wage rates respond to 
changes in supply aftd demand in the labor market. Solow offers 
the observation that his survey did not produce a lot of bard 
evidence: "What there is consists mostly of educated guesses. 11 
(Solow, 1980, p. 141) 

Baily and Tobin researched the macroeconomic effects of 
public employment programs and wage subsidies, trying to esti- 
mate the success of job creation by means of aggregated and 
disaggregated labor market models. They concluded that "the 
hypotheses necessary for success of direct job creation, wage 
subsidies, and kindred policies are empirically supported, at 
least qualitatively , " and, moreover, that 

a large £hare of the case for direct job creation . . . 
depends on important effects" not Captured in aggregate 
measures of employment and production: Improved distri- 
bution of income and opportunity. (Baily and Tobin, 1977, 
p. 539, emphasis added)* 

On the narrower issue of the, degree to which countercyclical em- 
ployment programs are able to accomplish their main goal of pro- 
viding funds for additions to the public employment rolls, we 
have a. good Jeal more hard data. 

ESTIMATING SUBSTITUTION AND DISPLACEMENT 
Substitution and displacement defined * 

Federal grants to enable State and local governments to hire 
people who are temporarily unemployed during economic recession 
can help make work available to the unemployed and also lessen 
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expenditures within Unemployment Insurance and the welfare system 
aad maintain the flow of income to the government.' Grants like 
those under titles IID and VI of CETA to increase the number of 
public service jobs available within State^and local jurisdic- 
tions allow prime sponsors to pay overhead, wages, and fringe 
.benefits for the people selected for thtfse jobs. Theoretically, 
Sjividing the amount of the grant by the average earnings allowed 
under the program's regulations yields a number equal to the net 
yearly addition to the public or nonprofit payroll . This number 
will reflect the actual net addition only if each job subsidized 
under the program is in fact a new position within the locality. 

For the most part, therefore, public employment and training 
program, regulations preclude States, cities, and nonprofit agen- 
cies from using the Federal grants to pay people who were on th* 
payroll before the programs began. Jn other words, Federal money 
for employing people who are out of work because of economic re- 
cession is not to. be 'used as a substitute for State or local mon- 
v ey nor is it to be used to displace existing employees with new 
ones declared eligible for employment under the program. 

Job displacement differs from fiscal substitution in that it 
refers to the number of subsidized employees added to the payroll 
who, in the absence of the grant, would have been employed anyway. 
It is a measure of employment substitution rather jthan fiscal 
substitution. -Job displacement 'and fiscal substitution are equal 
only when the distribution of displaced hours and wages is the 
same as the distribution of hours and wages supported by the 
grant • It is, therefore, incorrect to assume that the displace- 
ment effect and the substitution effect are necessarily the same. 

It is useful to understand 'how, the displacement issue re- 
lates to tlie equity and efficiency criteria we mentioned earlier. 
If employers in a given locality Itere to displace their regular 
< employees with nev/ ones hired ana paid under the public employ- 
ment program grant and if these new employees were more disadvan- 
taged than the regular employees, this would probably not be seen 
> as efficient but it might be seen as equitable. People who had 
been disadvantaged competitors in the labor market would now have 
jobs. However, the more that regular employees were being dis- 
placed by using the program funds in this way, the fewer new jobs 
would be created, and previously existing jobs would, simply be 
reshuffled from on 6 type of worker to another. (SoIqw, 1980) 

A more theoretical facet of the question, sometimes called 
the "vacuum effect," should also be kept in mind. It refers to 
instances in which the number of people who are involuntarily un- 
employed is signij^^nt. In these cases, the work that the pro- 
^ gram enrollees WOTf^^Boave taken up if -there were ho program is 
taken up instead b^^W^jrs. The others were also unemployed when 
the jobs were made available under the program but did not get 
one. From a social perspective , one mig|ht conclude that whether 
or not we can predict what employment the program enrollees would 
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hav^nad in the absence of the program is irrelevant because the 
"vacuum" will always be filled by someone in the labor market 
who is looking for work. (Jerrett and Barocci, 1979, p. 142) 



Determining t an appropriate rate 

Ideally, from the perspective of Federal policy, to open up 
the largest number of jobs for the least amount of money requires 
that local budget substitution be close to zero. Recent research, 
however, has produced a series of estimates indicating that Fed- 
eral funds are substituted for local funds at rates anywhere from 
as low as"~10 to as high as 100 percent. The wide range stems 
from the variety of estimation methods and time variablgre. In 
general, the monitoring studies in the/field yield the lower 
rates and the econometri^: analyses yield the higher. Some ob- 
servers contend that achieving a z/s^ro rate is highly unlikely be- 
cause the number of people employed under phe various programs is 
so large, local fiscal problems generally have high correlations 
with the recession that triggered the program in the first place, 
and the regulations usually require program enrollees to be "pro- 
ductively" employed. (Kemper and Moss, 1978; Kesselman, 1978) 

The regi^latibns governing eligibility for participation in 
employment and training programs were altered throughout 1973-79 
to make it more difficult for prime sponsors to use Federal funds 
to pay existing public workers — that is, to^make it harder to sub- 
stitute Federal money for local money. The most stringeht re- 
quirements are the latest, in the CETA Amendments of 1978, which 
are summarized as follows: * 

A person eligible to be employed under title VI should be: 

1. an individual — 

^ (a) who has been unemployed for at least 10 out of tVie 

12 weeks immediately prior to a determination and 
(b) who is unemployed at the time of the determination 
and 

2 . an individual — 

(a) whose family income does not exceed 100 percent of * 
the lower living standard income level based on the 
three month period prior to application? o£ 

(b) who is, or whose family is, receiving AFDC or SSI. 
(Pub. L. No. 95-524, sec. 607) 

Both the 1976 Act and the 1978 Amendments also specify that only 
a limited percentage of the Federal money pan be spent on crea- 
ting jobs related to ongoing State/ county, or city services; the 
rest must be spent to create subsidized jobs in special projects 
of limited duration. Additionally/ the pertinent legislation 
states tjiat - 

no individual shall be e-lTigible to be employed in a 
public service employment position, i£ such individual 
has, within 6 months prior to the determination, volun- 
tarily terminated, without good cause, his or her pre- 
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vious full-time employment at a wage rate not less than 
the Federal minimum wage .... (Pub. L. No. 95-524,, 

sec. 122N) * * 

« 

Notwithstanding Federal attempts to reduce substitution and 
displacement/ a number of arguments have been' of fered, against 
viewing them as totally negative phenomena. For one, some think 
it is entirely possible that substituting Federal for State and 
local funds does not have an overall negative effect on the 
amount of income that is generated by public service employment 
programs. If the State and local funds that are thus freed are 
used to support activities'that benefit the same or similar types 
of people as are targeted by the Federal program, for example, 
the effect is arguably positive. Similarly, if the purchasing 
power of the local government or the local residents were thus 
increased/ increasing in turn the income (and thus employment) 
of supplying firms and retailers to the same or to a greater ex- 
tent than the targeted funds would have, substitution would not 
necessarily be negative in terms of economic stimulation. Basi- 
cally , this argument maintains that a i! leakage" from the system 
is not the same as a loss and, although there is no empirical 
evidence for it, its logic has allowed it to maintain^ position 
in policy debate. (Killingsworth, 1977) 

Several other issues complicate the determihgtipri of appro- 
priate rates of substitution and displacement. One turns on the 
question of timeliness. In some instances , tihe receipt of Fed- 
eral funds might allow a city to clean up its\ river basin, for 
example, more rapidly than if the city had to\pay workers to do 
this out of local revenue. Whether or not Federal funds thus 

• facilitating a project that would have been done with local funds 
at some time in the, future falls under the heading of' substitu- 
tion depends on one's* viewpoint on time and effica'cy. 

Another issue turns on whether or not employment and training 
programs have a desirable effect on overall labor force employ- 
ability and the rate of wage inflation regardless of substitution. 
One could argue that in the long run they do if . regulations an<3 
local priorities for projects shift the demand for local labor 
fhore toward low-skilled disadvantaged workers / thus enhancing 
their employability . (Jerrett and Barocci, 1979) Finally, pro- 
ponents of Federal fiscal aid for employment purposes might well 
argue that if most of the funds are used to hire people who nped 
jobs, apy substitution of funds will be beneficial in much the 
same way that general revenue sharing would be, unless the funds 
were used to retire debt or to build a surplus in State and local 

• budgets . 

The substitution and displacement issues around CETA are 
clearly complicated ^Jn its most basic form, the main question 
is whether substitution and displacement occur and, if they do, 
to what extent do they and to what extent should they. Virtually 
all research on this question shows some degree of budget sub- 
stitution; the debate is about how much. The complexity of mon- 
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itoring methods and econometric estimation techniques diminishes 
our ability to fincf a point , estimate of substitution that would 
meet rigorous statistical and reliability standards • The wide 
variety of local budgetary systems , the question of the fungibil- 
ity or interchangeability of dollars, tracking problems, and the 
impossibility of creating an experimental environment in which we 
can determine ^what would\have happened to employment and the wage 
bill in the absence of a program all work against our finding a 
definitive answer. In the next section of this chapter, however, 
we summarize studies on the extent of substitution and displace- 
ment/ suggesting that federally imposed regulatory changes in x 
CETA titles IID and VI have lowered the rates ♦ These problems 
thus appear to be N at least partially amenable to solution by 
policy actions. 

The results of monitoring 
and econometric analyses 

f Recent studies of substitution and displacement have im- 

proved substantially over the earlier work* Nathan's 1978 moni- 
toring study fojr the Brookings Institution built fruitfully on 
t^Tfe. lessons in the National Planning Association's 1974 evalua-' 
tion and consider^ Its well, some of the subtleties in the econo- 
metric literatqre. Moreover, the 1979 econometric study by Bassi 
.and FecTvter took careful "account of previous criticisms of econo- 
metric specifications and structures that had been offered by > 
analysts in both thfe governmental and the academic communities • 
The Bassi and Fechter study is additionally valuable because it 
summarizes the evidence from virtually all the previous substitu- 
tion studies. In exhibit 5, we list in the order we discuss them 
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Exhibit 5 

Estimates of the Degree of Substitution and Displacement Associated with PSE 
(Keyed to List of References in Appendix II) 



SOURCE 

National Planning 
Assn., 1974 



Nathan, 1981 . * 



Johnson and TomO 1 a , 
1977 



Gramlich, 1979 



Bassi and Fechter, 
1979 



SAMPLE 

12 local governments 
from M high impact" 4 
demonstration project; 
cross- sect ion sample 
from 1971 * 

40 recipient govern- 
ments ip 1 977 

Aggregate time series 
data 1966-75 



National Income 
Accounts time series 
19$4-77 

States, 150 cities, 
100 counties; 'cross- 
section samples 1976 
and 1977 



METHOD 

Monitoring study, 
econometr ic 



Opinion survey, 
monitorimg study 

Econometr ic 



Econometr ic 



EconQmetr ic 



GRANT SUBSTITUTION/ DISPLACEMENT 
PEP 46% 1972 (jobs) 



PSE 18% July 1977; 15% 

December 1977 (jofcs) 

PSE 13% fiscal quarter 
«- approximately 90-100% 

fiscal quarters 5-6 (jobs) 

PSE 52% fiscal quarter 2; 
approximately 100% 
fiscal quarters 5-6 ($) 

PSE Approximately 50-60% 
1976; 36% 1977 ($) 
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five studies on substitution and displacement and giye,' bjrief 
indications of their data sources, methods/ and findings. 

^ In general, these studies on the PSE program show that it is 
impossible to pinpoint the exact rate of past or present fiscal 
substitution and displacement but tShat it is likely to have been 
at least 18 percent in PSE's first year &nd possibly as high as 
100 percent* after that. These studies also show that as the time 
increases between the initial grant and its evaluation, the like- 
lihood that more PSE jobs will be substituted for regular State 
and city jobs also increases. Fiscal stimulus for countercycli- 
cal employment appears to work best during the first two quarters 
of program operation; substitution increases after that. And, 
finally, there is limited evidence from which to conclude that 
regulatory revisions lessened the problem of substitution and 
displacement. In the remainder of this chapter, we summarize 
these research findings in somewhat greater detail. 

Monrtor ing studies 

V 

Although the National Planning Association study could be 
categorized as econonfetric because it used employment- levels to 
estimate what would have happened in the absence of the program, 
its principal method was onsite monitoring for purposes of deter- 
mining the rate of job displacement, not fiscal substitution, in 
twelve "high impact demonstration project" areas that had re- 
' ceived unusually large grants under the Public Employment Program 
(PEP), the predecessor of CETA titles IID and VI. Twelve sites 
in the same State or area with smaller PEP grants served as a 
comparison base, although the "high Impact demonstration proj- 
ect" areas had higher rates of* unemployment than the "regular ' 
PEP grant \ areas. Employment figures were available for all the 
sites for\he period studied (October 1972). The rate of 'em- v 
ployment change was used to estimate what would have happened 'in 
the high-impact demonstration PEP sites had there been no pro- 
gram. The difference in employment levels between the demonstra- 
tion sites and the comparison sites was offered as the estimate m 
of net new job creation resulting from PEP funds. The NPA study 
concluded that after slightly less than one year only 54 percent 
of the jobs in the areas receiving grants were new— that is, they 
p would not have existed without the program. This translates into 
a job displacement rate of 46 ^percent. 

The study's method was widely criticized. Critics pointed 
out that the data for the "comparison sites" were contaminated 
by the presence in the employment figures of an unknown number 
of job holders who had been hired with PEP funds. Critics added 
that partially as a result of this the displacement rate had 
been miscalculated. They also found fault because no adjust- 
ment had been made in the study for the actual pattern and timing 
of the program's implementation. Perhaps the most telling indict- 
ment came from the NPA itself, which stated in its final report 
that 



the major problem throughout the study was the lack of 
appropriate control groups. There were no economic data 
(other than unemployment rates) for areas comparable to 
the demonstration sites. Also, there was no control 
group for the participants. These omissions make sus- 
pect most of the results presented in this report. 
(National Planning Assn., 1974, p. 9; see also 
Wiseman, 1976, p. 87) 

In sum, even NPA's care in- setting up comparable governmental 
units for comparison sites did -not enable it to make definitive 
conclusions about public service employment. 

The. Brookings Institution thereafter launched an extensive 
monitoring study of PSE under Nathan's direction. The research 
^associates he hired were residents of the areas they were study- 
ing and were therefore able tb maintain contact with both CETA 
and local budgetary authorities for continuous periods. As a re- 
sult, their observations of employment and budgetary data between 
July and December 1977 on an overall sample of 40 jurisdictions 
--representing 10 percent ofVall PSE enrollees— are quite speci- 
fic. Their initial results indicated an 18 percent substitution 
rate in July 1977 or, conversely, that 82 percent of the Federal 
funds were used for new positions that could be called net addi- 
tions to the number of availablje^obs . For the second .wave of 
observations in December 1977, the substitution rate was slightly 
lower at 15 percent. (Nathan, 1981) 

» 

As. all monitoring studies do, this one relied to. a^great 
extent on the judgment of the individuals in the field. Even 
with care, there can be no assurance, therefore, that Nathan's 
researchers were able 'to ask comparably placed public officials 
the same questions or that another set of researchers would have 
reached the same conclusions. Indeed, t^heir -figures should be 
taken as the lower bound of the substitution rate. Av further r 
caveat regarding this study's results is that they may have been 
influenced by the fact that the PSE program was in the process 
of some institutional changes caused by regulatory tightening at 
the time of the study. 

Econometric studies 
. — • ' 

In 197 7, Johnson and Tomola published a paper irT^which ' 
they estimated substitution rates from analysis of time series 
data on aggregate norisubsidized employment in State and local 
jurisdictions. They concluded that the substitution rate was 
13 percent or less in the first two fiscal quarters and about 
100 percent in the fifth and sixth fiscal quarters.' 

A detailed criticism by Wiseman claimed that the .results 
of the analysis by Johnson and Tomola were not stable when the 
model specifications were changed. Moreover, the standard errors 
around the' estimates were very large, meaning that the real sub- 
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.stitution rate could fall within a wide range. Other critics 
pointed out, for example,' that , 

although the paper suggests that net job creation after 
six quarters 'is essentially zero per 100 PSE 'slots funded, 
one can only lie 95 percent sure that this figure is between 
110 n$t jobs created and 114 net jobs lost. (Borus and 
Hammermesh , 1978, p. 118) 

In 1,979, Gramlich used a fiscal impact model with quarterly 
national income account data from 1954-77 to estimate the substi- 
tution effects of CETA PSE funds. His estimates showed that 
only 48 cents in each dollar were for new expenditure, with 50 
cents going into surplus funds and 2 cents going into tax reduc- 
tion by the end of the second fiscal quarter. By the fifth and 
sixth fiscal quarters, the substitution rate estimates were close 
to 100 percent. 

Finally, after criticizing the previous studies extensively, 
Bassi and Fechter built a new econometric .model , basing it oa 
Gramlich' s model and later updating it in their final report, 
published by the Department' of Labor in 1979. They generated 
a number of alternative estimates, using cross-sectional data on 
Sfcates and samples of 150 cities and 100 counties and looking at 
wage bills. Referring to the changes in PSE regulations we men- 
tioned earlier as tightening the eligibility requirements, the 
results "of their study suggested 

a, fiscal substitution rate of 36 percent in 1977 as 
Compared to 50 to 60 percent in earlier years. These 
estimates, however, are not statistically different 
from, one another. It is difficult, nonetheless, to 
ignore the difference in them. These estimates, in 
conjunction with Nathan, 1 , s estimate of 18 percenft sub- 
stitution in 1977, indicate that substitution lias been 
reduced under the revised program. The efficac\y of PSE 
as a countercyclical tool, however, cannot adequately 
be determined on the basis of this limited evidence. 
(Bassi and Fechter, 1979, p. A-12) 

Indeed, 3 reading of the regulations shows that it is prob- 
ably very difficult for employers to adhere to the regulations 
and at the same time employ people outside the program who have 
already^een on the payroll. Moreover, under the present PSE 
segulaitions , it appears difficult to hire anyone not truly in 
need of' a 'job. 

In summary, v as Bassi and Fechter have noted , reviewing 
studies on substitution and displacement shows a wide range of 
estimates, the variation stemming from incomparabilities between 
studies in terms of their methods , timeframes, and units of anal- 
ysis/ The monitoring studies generally arrived at rates lower 
than the econometric analyses did. Looking at the timeframes of 
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the studies, we also find at least a suggestion that tightening 
the PSE regulations led to less substitution and displacement - 
by 1977. 

Should substitution and displacement associated with Federal 
employment and training programs like CETA be reduced to zero? 
Can they be reduced? In theory, as we have seen, the answer may' 
be yes. In practice, the answer may be that reduction to zero 
is neither possible nor desirable. It should also be noted that, 
according to some views, even if fiscal substitution were reduced 
to zero, the net job creation might not be positive, since the 
/Jebt-financed program/could have crowded out private spending, 
r resulting in the same number of jobs. * 
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SUMMARY AN13 INTERPRETATION 



4 fc 

Throughout this report, we have summarized a variety of 
information sources on classroom training— on-the-job training, 
work experience, and public service employment as adult services 
provided under titles IIB, IID, 'and VI of the Comprehensive Em- 
ployment and Training Act. Given all the relevant data, we asked 
five questions about these services. (1) Who were the enrollees? 

(2) What types of service and what benefits .were provided them? 

(3) Who were the recipients of the various types of service? (4) 
What were the employment experiences of the enrollees both before 
and after participating in CETA? (5) How effective were the serv- 
ices? TO the Extent that data were available, we also asked the 
same questions about the new title VII, the Private Sector^ Initi- 
ative Program. In the first part of this final chapter, we. give 

a brief overview of the answers to these questions. In the re- 
mainder of the chapter, we try to show how the answers to these 
questions are often intertwined. We set them in context by pre- 
senting eight points of interpretation for them, and we point 
to important gaps in our knowledge about ardult CETA services. 

*WHO WERE CETA'S ENROLLEES? 

Significant proportions of enrollees in the Comprehensive 
Services and Public Service Employment titles were disadvantaged 
economically and educationally when they entered the program and 
trlfey had little past employment stability. Approximately one- 
third of those who enrolled in the four major adult services " 
between fiscal year 19Z6 and fiscal year 1978 were unemployed'. 
at least 50 percent of the-year preceding their enrollment, and 
another one- fourth to one-third were oiW-T)f the labor force at 
least 50 percent of that year. From 7CV to 80 percent. of the fis- 
cal 1975, 19 77, and 1979 Comprehensive ServiceT&stitle IIB enroll- 
ees were at or below the OMB povef-t^ level. In fiscal 1979, 
from 60 to 70 percent of PSE titles IID and VI enrollees were at 
or below the OMB poverty level; in earlier years, the economi- 
cally disadvantaged constituted only half of all PSE enrollees. 
Slightly more than one-fourth of the fisoal 1979 enrollees were 
high school dropouts. 



WHAT TYPES OF SERVICE AND WHAT BENEFITS 
WERE PROVIDED TO CETA ENROLLEES?' 



When we consider Comprehensive Services enrollees in the 
four service types, we find that over time the service mix, 
shifted away from work experience and toward classroom training. 
Classroom training was given to one-fourth of the fiscal 197 5 
enrollees in the four services but to almost half of the fiscal 
1980 enrollees. On-the-job training also increased under title 
IIB but only slightly— from 8 percent to 13 percent. Work expe- 
rience was the major service in fiscal 1975 at 63 percent but de- 



ERIC 




creased to 39 percent of the service mix in fiscal 1980. However, 
with the initiation and growth of the PSE titles, the overall 
adult service mix in CETA placed increased emphasis on various 
forms of subsidized work opportunities. 

Occupational areas of employment and training services var- 
ied by service type. In fiscal year 1976, public service employ- 
ment and work experience participants were concentrated in cleri- 
cal, service, and laborer occupational areas. Classroom training 
participants were also concentrated in the clerical area, but 
both classroom training and on-the-job training piTfe- more emphasis 
on craft and operative occupations than did either public service 
employment or work experience. 

On .the average, early participants in work experience, on- 
the-job training , and public service employment realized substan- 
tial earnings improvements while they were in the program compared 
to their preprogram earnings. Classroom training participants of- 
ten received training allowances, but the data are inadequate and 
do not allow us 'to assess their earnings improvements. More than 
85 percent of the early participants in CETA adult services indi- 
cated that they were §ither satisfied or very satisfied with the 
program. Nearly half of thjem had received some form of ancillary 
employment and support services beyond skills training and^sub- 
sidized work opportunities. 

Placement rates at the time people terminated from CETA 
ranged between 28 and 45 percent for the Comprehensive Services; • 
title in fiscal 1975-8CUand 31 to 42 percent for the PSE titles, 
according to data from DOL 1 s prime sponsor reporting systAw ~ 
The Continuous Longitudinal Manpower Survey data on fiscal* year 
1976 enrollees, based on both prime sponsor records and inter- 
views with terminees, indicated somewhat higher rates--39 per- 
cent for classroom training, 55 percent for work experience, 67 
percent for public service employment, and 69 percent for on- 
the-job training. These data indicate that DOL national data on 
termination status may underestimate the percentage of people 
actually entering employment as they exit from CETA. 

WHO WERE THE RECIPIENTS 
OF THE VARIOUS TYPES 
OF SERVICE? 

With respect to the matching of people and services, class-, 
room training and work experience had a higher percentage of fe- ' ■ 
male enrollees than on-the-job training and^ public service em- 
ployment. Moreover, classroom training and" work experience had 
more-disadvantaged participant profiles than on-the-job training. 
That is, enrollees were more likely to come from households be- 
low the 0MB poverty level, with family incomes "less than $6,000, 
with individual incomes less than $1,000, and from households re- 
ceiving public benefits. In terms of their employment stability, 
they were moi^ likely to have been unemployed over half of the 



preceding year- In fiscal 1976, the public service employment 
participants, like those in on-tlje-job training, were relatively 
less disadvantaged than other participants, but by fiscal 1978 
the profiles of public -service employment participants had come 
to resemble more closely those of the classroom training and work 
experience participants. 

WHAT WERE ENROLLEES ' EMPLOYMENT 

EXPERIENCES BEFORE AND AFTER ' 
PARTICIPATING IN CETA? 

Descriptive data on the experiences ' of early CETA partici- 
pants before they enrolled and one to two years after they left 
indicate that their earnings and employment circumstances improved 
and that the percentage of participants in households receiving 
public benefits decreased. However, the proportion of employed 
people in private sector jobs as opposed to public sector jobs 
also decreased.' These outcomes differed by service type and de- 
mographic subgroup. 
•* 

Earnings and employment declined in a consistent pattern for 
CETA participants in the year preceding enrollment, but, on aver- 
age, after leaving the program they immediately attained earnings ^ 
and employment levels equal to and sometimes exceeding the high 
point of their pre-CETA year. They continued to show increases 
over the next two years. T)>e proportion of participants in house- 
holds receiving public ben/fits decreased from 38 percent in the 
year before CETA to 25 percent two years after CETA. The per- 
centage of people receiving Unemployment Insurance payments also 
dropped, from 26 percent to 15 percent, over this period. 

When they are considered by service type, classroom training 
and work experience participants had generally poorer earnings 
and employment circumstances than on-the-job training and public 
service employment participants, both before and after CETA. The 
households of people in classroom training and work experience 
were also more likely to have received some form o*f public bene- 
fit both before and after CETA than those of participants in the 
other service types. On average, early participants in all four 
service types demonstrated improvements in employment .and earn- 
ings circumstances from before to after CETA, and their circum- 
stances continued to improve over time. The largest gains in 
earnings and percentage of time employed were obtained by on-the- 
job training participants; work experience participants had the 
smallest gains. People in public service employment and class- 
room training stood between these two groups. 

For January-June 1975 participants, employment location 
shifted somewhat toward the public sector before and after CETA. 
Of those employed one year before CETA, 82 percent had held jobs 
in the private sector, but only 66 percent of those employed held 
private sector jobs two years after CETA. Employed terminees 
from classroom training and on-the-job training were much more 
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likely to have found jobs in the private sector two .years after 
leaving CETA (84 and 83 percent, respectively) than terminees 
from work experience an* public service employment (65 and 52 
percent, respectively). Participants in fiscal 1£76 were more 
likely to be employed in private sector jobs after CETA than 
were 1975 participants. 

When we consider demographic subgroups, we find that past- 
program average annualized earnings 10 to 12 months after CETA 
were greater than $5,000 for men, people with at least a high 
school education, people aged 22-44, whites, and the noneconom- 
lcally disadvantaged at entry. Women, people with education at 
the 9th to 11th grade level, and blacks had less than, $4,000 in 
average annualized earnings. These differences may be partly a 
function of differences in occupational' areas of employment after 
CETA. For example, almost 50 percent of the employed women held 
clerical jobs. Only 6 percent of the employed men did. Of the 
men, 45 percent had jobs in crafts or as operatives. Only 13 
percent of the women did. Greater percentages of people older 
than 45; people who had not graduated from high school, and 
blacks were employed after CETA in service jobs. 

HOW EFFECTIVE WERE THE SERVICES? 

* 

/ The effectiveness of CETA adult services has been addressed 
so far only for fiscal 1976 parti cipants_£ind with a single cri- 
terion — participants' earnings. In a comparison of Continuous 
Longitudinal Manpower Survey samples s of CETA participants with 
matched groups drawn from Mihe Current Population Survey, estimat-r 
mg net impact of -program participation on 1977 earnings covered 
by Social Security, it was found that in general only $300 to 
$400 of participants' 1977 earnings could be attributed to CETA. 
This constituted a 7 percent increase over the earnings of the 
matched comparison group. Results varied by service type and 
demographic ykubgroup. 



Results examined by service type show that the largest 
estimated net gain, at $850, was for people who had on-the-job 
training. They were followed by classroom training and multiple 
services participants, at $350, and public service employment 
participants with a net gain of $250 ($350 to $750 if adjusted 
for Social Security noncoverage ) . No positive effect was evident 
'for people who had been enrolled in work experience. 

Results examined by race and gender subgroups show statis- 
tically significant, gains from CETA for both white and minority 
women of between $500 and $600. Men's gains of $'200 were not 
statistically significant. Also, people whose earnings were 
less than $2,000 in the two years 1973 and 1974 before CETA— 50 
percent of all participants— gained an estimated $550 frotf their 
experience in CETA, but others whose earnings had been intermedi- 
ate and mixed or higher in general did not realize statistically 
significant gains in earnings. 
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Distributions of gross earnings changes 'from 1974 to 1977 for 
the same groups used in these net impact analyses show a higher 
frequency of 'individual gains — of more than $4,000 for white and 
minority women and people with the poorest earnings histories in 
CETA — than for their comparison groups* This- suggests that even 
though the net impact in the aggregate may have been small, some 
proportion of these groups may have profited substantially from 
CETA. 

JHE PRIVATE SECTOR INITIATIVE PROGRAM 

Our summary of what we know about the Private Sector Initia- 
tive Program (PSIP), title VII of CETA, is extremely brief. The 
program did not become fully operational until fiscal 198(3, andf 
available information allows us to address only three questions: 
Who were the enrollees? What types of service were provided them? 
What was their status at the time they left? No analysis of net 
effects is possible. 

In fiscal 1980, PSIP served fewer than 58,000 people, in con- 
trast to the more than one million served through the Comprehen- 
sive Services title. PSIP enrollees were roughly similar to enrol- 
lees in Comprehensive Services, except that PSIP n served a larger- 
proportion of men and high school graduates and smaller proportions 
of high school students and people in households receiving public 
benefits. PSIP appears to have delivered the same types of service 
as the Comprehensive Services title, with a heavier emphasis on 
classroom training and on-the-job training and less emphasis on 
work experience. 

? 

Five percent more PSIP terminees entered unsubsidized employ- 
ment when they left CETA than terminees from the Comprehensive 
Services title, and 8 per cent more PSIP terminees entered employ- 
ment in the private sector. Additionally, PSIP had 10 percent more 
terminees entering unsubsidized employment and 20 percent more 
terminees entering employment in the private sector than did the 
PSE tides. . 

CONCLUDING OBSERVATIONS 

As we arrayed what learned about CETA adult-oriented 
services, it became evident that the answers to our questions 
were often intertwined. Thus, interpreting correctly one piece 
of information frequently required attending to other information 
as well. Additionally, our search fcjr answers to questions about 
enrollees, services, and effectiveness pointed up important gaps 
in what is known about CETA. 

How can we interpret the data? 

To understand the data on CETA adult services and the bene- 
fits participants derived from them, we have to place the findings 
in a broad context and examine ^their implications and limitations. 
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The following eight points should be kept in mind when interpret- 
ing information on CETA. 



First, the^tost comprehensive information we have on adu.Lt 
services is^lso the least current. To the extent that con- 
ditions ha\p changed since CETA's inception, our ability to 
generalize If rom the experiences of participants in CETA's early 
years to today's participants is- reduced. Results for PSE are 
the most/ulnerable in our attempts to generalize, since PSE has 
undergoes the most dramatic changes with respect to enrollee 
characteristics and- allowable activities. 

i 

w Second, there is some evidence that changes in regulations 
had their intended effect in targeting CETA on the disadvantaged. 
Few differences were found over time in the characteristics of 
participants in the Comprehensive Services title, but profiles foQ 
PSE participants show them as becoming more disadvantaged in the 
later years of the program. The nature of PSE occupations also 
changed, probably because of requirements "to create jobs in proj- 
ects rather 1;han in ongoing government services and because of 
eligibility, time, and wage restrictions. Studies of substitution 
and PSE vary widely in their estimates but indicate that regula- 
tory changes may also have been successful in reducing the sub- 
stitution of Federal PSE money for local money. 

Third, interpreting outqome and effectiveness information on 
service types requires us to attend to the somewhat different ob- 
jectives of the services and the heterogeneous needs of the unem- 
ployed. For one thing, the CETA intake process legitimately re- 
sults in different participant profiles across service types, and 
for another the services themselves emphasize different occupa- 
tional areas. Both these factors are likely to affect program 
outcomes, regardless of the "mode" of service delivery. 

On-the-job training, as an example of the first factor, had 

the -le<rst-disadvantaged participant profile and the best out 

comes; work experience had a relatively more-disadvantaged par- 
ticipant profile and poorer outcomes. When we make direct com- 
parisons of postprogram outcomes across service types, therefore, 
we must account for these facts. Even in the net impact analy- 
sis, which adjusted for differences between enrollee groups by 
using matching and regression techniques, it is unknown whether 
the attempt to match and statistically adjust for nonequivalences 
between groups was successful. 

The nature o.f the services received the second factor, 
varies both in terms of whether opportunities exist for exposure 
to potential employers—that is, whether participants enter subsi- 
dized work opportunities or enter classroom training—and in terms 
of exposure to occupational areas. Evidence from the ^early years 
of CETA shows that the occupational areas of within-program train- 
ing and employment differed by service type. Both classroom and 
on-the-job training put more emphasis on exposure to craft and 
operative occupations than the other services did^ To the extent 
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that higher postprogram \tages are Associated with these occupa- 
tions, it is not surprising to find better outcomes for these 
service types. In slam, differences in outcomes between, 'service 
types may be a function of the characteristics of the enrollees 
and the nature of occupational exposure as much as or more than 
anything else. * % y 

Another consideration in comparing service types pertains to 
our lack of information on the association between prime sponsor 
service mix and local fiscal and labor market conditions. Over- 
ail, CETA's mix of adult services from 1975 to 1980 became in- 
creasingly oriented toward subsidized work opportunities, but 
within the Comprehensive Services title the mix of the four basic 
services shifted toward fostering educational and occupational 
skills. In the Ajgregate*. prime sponsors have moved toward pro- 
viding more int^isive services aimed at developing human capital 
while still relying* heavHy on work experience, which constituted^ 
39 percent of the service mix in the* Comprehensive Services title 
in fiscal 1980. This continued reliance may reflect both the 
assessed needs of their enrollees and limitations in community 
resources that work against expanding classroom and on-the-job 
training opportunities. 

The large variation that exists in service mix across prime 
sponsors may be partly a function of varying degrees of availa- 
bility of resources or of fiscal pressures to use funds in other 
ways. For instance, a prime sponsor in a city experiencing fi- 
nancial stress and high unemployment may find it difficult to 
create on-the-job training opportunities but may find it easy to 
offer work experience. To the extent that service mix is associ- 
ated with such local conditions, national comparisons that are 
intended to reveal something about the relative effectiveness of 
various types of service may additionally be comparing the char- 
acteristics of prime sponsors and their economic circumstances. 

Additionally, in comparing service types, we need to remem- 
ber that there is, a substantial amount of overlap between serv- 
ice types as well as variation' within service types. The serv- 
ices are designated by general operational characteristics, yet 
•on-the-job training, work experience, and public service employ- 
ment all provide, for example, some form of subsidized work 
opportunity. Comparisons across service types are, thus, some- 
times comparisons of participants with similar wi thin-program 
experiences. In fact, the experiences of two participants in 
different services may resemble each other more closely than the 
experiences of two participants within a single service type. 
Classroom training, in particular, manifests great variability 
because of its dual purpose of providing education and occupa- 
tional training . 

Fourth, placement rate^ldata must be interpreted very cau- 
tiously. The conflicting results of validation studies on place- 
ment rates as predictors of long-term program effectiveness, and 
other ambiguities associated with their use even in the short 




117 



\ 



term, present a convincing argument against using placement rates 
in ispiation as program performance indicators^ A high placement 
rate can mean that a program is highly ef fective7\ that it is serv- 
ing people who are relatively employable even withbut CETA, or 
that it is moving people into unstable, low-wage jobs. It could 
reflect a number of other things as well. One riskjin using 
placement rates for judging the performance of individual prime 
sponsors is that the practice may discourage them from providing 
more intensive and long-term services or from serving the most 
needy. Therefore, although discrepancies between the DOL and 
CLMS data suggest that a greater number of people secure jobs 
soon aftter leaving CETA than has been reported by prime sponsors, 
placement rai^s remain doubtful indicators of program performance. 

Fifth, the information presented in chapter 5 on partici- 
pants' earnings, employment, and receipt of public benefits 
before and after CETA should be taken as descriptive - only . It 
does not necessarily indicate program effectiveness. To what 
extent CETA participants' circumstances would have improved if 
there had been no program cannot be deduced from this type of in- 
formation alone. For one thing, the deteriorating earnings and 
employment status of participants in their y.ear before entering 
CETA is to some unknown degree a function of transitory or per- 
manent factors or both. At entry y CETA participants were on av- 
erage at a low point in their earnings and employment. This is 
precisely why many found CETA attractive. Looking back from that 
low point through the§12 months before, it is only reasonable to 
find that their circumstances were better at some earlier time. 
Only if we assume that whatever disrupted their employment pattern 
was permanent could we attribute any postprogram improvements to 
CETA. 

« 

These data. on changes between preprogram and postprogram ex- 
periences are suggestive, however. There was a general pattern 
of improvement in earnings and employment immediately after CETA 
to levels above the high point of the pre-CETA year, and that 
this improvement continued over time without relapse is encourag- 
ing. The same. holds for reductions in the numbers of participant 
households receiving public benefits after CETA, although these 
numbers are of lesser quality and the dollar amounts of reductions 
in transfer payments are not^ available . 

As we loo\ at the pre-post pattern, however, we need to 
remember that this is not a homogeneous group of participants. 
T^e data present aggregations across several groups. About one- 
third of the entrants had been unemployed during most -of the year 
before entering CETA, another quarter to *a third had not been in 
the labor force at all, and a small percentage had fairly stable 
employment "that for, some unknown reason had been disrupted, 
either temporarily or permanently. 

• Sixth, the net impact estimates of CETA on 1977 earnings are 
far from the final word on CETA 1 s effectiveness. Though they are 
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the product of reasonable methods* and state-of-the-art analysis 
techniques,- they are based on 'a single approach and on only one 
outcome criterion — earnings. Also, estimates are currently 
available only for fiscal 1976 participants. The authors of the 
net impact study themselves recognise these limitations and 
caution us to view the results in a, broad perspective: 

The restripted nature of the estimates . . . must be 
kept in mind. This is not an overall evaluation of 
CETA programs, since certain CETA activities are omit- 
ted. Furthermore, it takes no account of the impact of 
CETA on the local job market, or other possible indi- 
rect benefits to society from adding to human capital. 
Neither does it take into accfount costs of the program 
nor the value of goods and services produced by partic- 
ipants while in the program. (Westat, 1981a, p. 3-21) 

Other qualifiers of the estimates include the adequacy of match- 
ing procedures and analysis techniques for adjusting for individ- 
ual characteristics and employment disruptions- Some comparison 
group members probably did participate in CETA, contaminating the 
comparison group, and others, for reasons unknown, did not find 
CETA an attractive means of assistance. That some jobs are not 
covered by Social Security and that work experience and public 
servic^ employment terminees ars more likely to be found in these 
jobs than other terminees or than comparison group members create 
further problems. 

Future analyses of the Continuous Longitudinal Manpower 
Survey data may eliminate some- of these problems, but others are 
likely to remain insoluble. Exploratory analyses by Westat of 
earnings data for 1975 participants demonstrate the sensitivity 
of the net impact estimates to various matching and analysis pro- 
cedures. Ongoingknalyses will test the stability of the present 
findings for the fiscal 1976 data. For all these reasons, it 
makes most sense to take the net impact estimates as merely gen- 
eral patterns rather than point estimates. 

Seventh, the PSIP program is still too young to allow us to 
assess its effectiveness. Its overall placement rates and rates 
of private sector employment are slightly higher than for the 
Comprehensive Services titles, but these differences are not un- 
expected, given the program's smaller size, greater emphasis on 
on-the-job and classroom training, and less-disadvantaged partic- 
ipant profile. PSIP serves lower proportions of women and peo- 
ple in households receiving public benefits. Little evidence 
exists at present that the Private Industry Councils are being 
innovative, but this is not to. say that new appifaadh^s will not * 
appear in the future. Building a program that finks p^vate and' 
public sectors takes time. There is a possibility, however, that 
if PSIP expands, the Councils will end up competing with prime 
sponsors for scarce employment and training resources such as 
on-the-job training positions. 




Eighth, and last, it should be recognized that a. lack of 
information is not the same thing as a failure in program effec- 
tiveness . The criteria for assessi-ng CETA's effectiveness are 
multiple. As we noted in chapter 3, evaluations of employment 
and training programs can also appropriately focus on such things 
as reductions in transfer payments, increases in human capital 
increases in the value of outputs from job components, reductions 

crime (or prevention of increases), increases in tax revenue, 
increases in labor force attachment, and increases in self- 
esteem. Moreover, focusing on earnings, finding a point estimate 
of gam in the first year after participation, is arguably less 
appropriate than giving attention to whether earners have been 
put on a different and steeper earnings path. First-year out- 
comes alone may give a distorted pictire of a program's effec- 
tiveness if people ..entering CETA havelforgone other opportunities 
that might have given them greater shdrt-term benefits. 

\ ^ C ' 

Our appraisals of service effectiveness must be guided by 
some clarification of program objectives. In the past, for exam- 
ple, similar evaluation criteria were /applied to counterstructural 
and countercyclical services. Net impact estimates of CETA's ef- 
fects on the earnings of PSE participants have been compared with 
those of participants in other service types. Since PSE title VI 
was conceived of as a countercyclical program, however—one to 
assist workers temporarily unemployed in recessionary times—earn- 
ings gains are not an obvious criterion for assessing PSE. In- 
deed, even expecting participants to maintain their preprogram 
earnings levels is a stringent criterion for countercyclical 
services. 

What more do we need to find out? 

The Continuous Longitudinal Manpower Survey offers a rich 
data base for seeking answers to questions beyond those about 
earnings gains. Additionally, as data on more recent CETA par- 
ticipants become available, and as other analysts apply them- 
selves to these data, we will surely develop more comprehensive 
information on the effectiveness of Federal employment and train- 
ing efforts than we now have for these and, indeed, for most 
other kinds of social programs. 

The U.S. Department of Labor has concentrated its evaluation' 
resources on conducting implementation studies for quick feedback 
to managers and on developing long-term information on overall 
program effectiveness.. The prime sponsor reporting requirements 
have been designed to- assist Federal monitoring while remaining 
as little intrusive and burdensome as possible, consistent with 
CETA's identity as a decentralized program. Even so, information 
gaps remain. Some of the gaps in our knowledge about CETA will 
be filled by ongoing and future data collection and analysis of 
the Continuous Longitudinal Manpower Survey. Despite all this, 
some.gaps are not likely ever to be filled. The National Council 
on Employment Policy has aptly described the limitation^ on what 
evaluation can tell us: ^ 
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Employment and training policies must rest on informed 
judgments rather than unequivocal findings. Evaluations 
can be improved, but even the best studies will leave many 
questions unanswered. ( The Impact , 1976, p. 2) 

It is possible, however, to outline a number of areas in 
which general understanding, and therefore perhaps operation, of 
employment and training programs might be improved. These areas 
might be addressed through CLMS and additional evaluation studies, 
including geospecific indicators on CLMS would make it possible 
to assess the influences on CETA performance (as measures by 
earnings gains) of local labor market conditions, industry de- 
mands for occupations, and the fiscal conditions of local govern- 
ments. Procedures are available that could make possible the 
merging of data on local community economic circumstances with 
individual survey records without risking the disclosure of 
individual CETA enrollees' identities. This merging would per- 
mit us to obtain a better understanding of the degree to which 
CETA's effectiveness is susceptible to local community circum- 
stances and could provide an expectation baseline for prime 
sponsor performance. -2* 

Among studies that are nee'ded are explorations of the fac- 
tors that govern service mix for the individual prime sponsor, 
especially given that participants in some service types have 
better outcomes than others. At this point, it is unclear 
whether the local service mix is a function of staff philosophy, 
procedural requirements, availability of community resources, or 
other factors. Without an understanding of local limitations, 
prohibiting certain types of service or recommending delivery of 
at least minimum levels of others may not accomplish anything. 
A recommendation that a community increase on-the-job training 
will not sudseed if, for example, the community's employers are 
deterred by thV paperwork required or if its resources for on- 
the-job training have already been exhausted. Identifying and • 
understanding what it is that shapes service mix could help 
reduce constraints operating on .local service providers. 

Another gap in our knowledge has been mentioned throughout 
this report — it is that the only measure of program effective- 
ness so- far available for CETA adult services is net earnings 
gains. Although gain in earnings is the stated legislative 
objective of the program— and although it probably serves rea- 
sonably as a proxy for several of the other possible criteria. we 
have discussed — the benefits of employment and training programs 
may extend beyond"" it . Assessing such things as whether receipt 
of public benefits like AFDC decreased and by how much and whether 
these programs result in increased value of outputs would help us 
put federally funded employment and training activities in a 

broader perspective, 
w 

Finally, information is needed on prime sponsor management 
procedures and on ways to assess the quality of services prime 
sponsors provide. If it were known which prime sponsors have 
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the soundest management procedures, the other sponsors who are 
not performing as well might be better assisted. If mo re weres 
known about the aspects of operations that relate to effective- 
ness, more useful technical assistance might be provided to 
State and local operators. 

In summary, our findings indicate that, on average, CETA 
adul.t services were given to people who were disadvantaged from 
several standpoints— economic status, educational status, and ' 
employment stability. The complexity of this program that seeks 
to match individual needs and local service resources results, as 
expected, in different participant profiles for the four service 
IVtL c - 6 differences and variations in occupational areas 
or the services make comparisons across service types somewhat 
tJrni^l V° 1 ?. ter P re V However, comparisons of employment and 
earnings experiences for early participants in CETA before and 
?! " ' ^ r P art ^ cl Pation are encouraging, especially since there 
is no evidence of a relapse over two years time. Although the 
° n J Y !!"^ bl ! net im P act analysis indicates that in the aggregate 
°^ y -f 00 , tO . $40 ° ° f 1976 Participants' 1977 earnings can be 
S direCtl V° CETA ' anal y se s ^ subgroups and patterns 

ot gross earnings changes suggest that many women and previous lv 
low earners *|iay have profited substantially from the program. 
While there are gaps in our understanding of the program; the 

^5n r ^ tl0 V hat ? e haVe f ° r CETA adult services is much richer 
than the information we have for most other social programs. 
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APPENDIX I '• APPENDIX I 

TECHNICAL DESCRIPTION OF PROCEDURES 

USED IN THE CLMS NET IMPACT ANALYSIS 

In this appendix/ we summarize the matching and analysis 
procedures used in the net impact estimates described in chapter 
6. More detailed discussions of these procedures and their 
justification can be found in Westat's Net Impact Report No* 1 , 
(WestaLt, 1981a) and in Westat's unpublished working papers. 

Estimates of th-e-J.9*77 net earnings impact of participation 
in adult-orienfeed CETA services were derived from differences 
in Social Security-covered earnings between a sample of CETA 
participants and a matched comparison group selected from the 
Current population Survey (CPS). The net impact study thits 
relied on two procedures to compensate for the lack of a ran- 
domized control group — creation of an artificial comparison 
group through matching and adjustment for background factors 
by regression methods. 

SAMPLES 

The sample of CETA participants, the Continuous Longitudinal 
Manpower Survey (CLMS) sample, consisted of people participating 
in CETA classroom training, on-the-job trailing, adult work expe- 
rience, or public service employment or some combination of. these 
who iiad enrolled during fiscal year 1976 and had terminated by 
December 31, 1976. They were required to participate a minimum 
of eijght days* People receiving only direct referral service and^ 
people participating in a summer youth program were excluded. 

[The comparison group was selected from the March 1976 CPS 
on the basis of matching procedures described below. To avoid 
matching CETA participants with people n'ot in che labor force, 
CPS respondents were excluded if they were no! working or seeking 
work! during the survey week. An exception war. made if they had 
wbrked some portion of calendar 1975. 

For both the CETA sample and fehe CPS comparison group, 
people were eliminated from the files who^were younger than 
14, older than 60, earned more than $20,000 the previous year, 
or had family income of more than $30,000 the previous y ea3 f. 
When the earnings information from the Social Security Adminis- 
tration was merged with the CETA and CPS files, people were 
excluded whose records did not match on at least three of five 
characteristics — year of birth, month of tirth," sex, race, and 
the first six characters of the surname. These procedures made 
38,892 CPS records available for matching. 

MATCHING PROCEDURES 

From its earlier, unpublished analyses, suggesting that 
postprogram earnings are predicted, by different factors for 
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preprogram lower earners compared to higher earners, Westat 
concluded that matching for the CETA (CLMS) sample and the CPS 
sample should proceed on the basis of earnings histories. Accord- 
ingly, consistently higher preprogram earners — that is, for years 
1973 and 1974 — were separated from consistently lower earners. 
The CETA and CPS files were divided into three parts, and further 
matches were made within each. 

Low e&rners were people whose SSA reported earnings were 
below $2,000 in both 1973 and 1974 and who in interviews reported 
earnings of 16ss than $4,000 in the year before the interview. 
Intermediate or mixed earners were people who did not fit the 
definition of either -low or higher earners. Higher earners 
were people whose SSA reported earnings were $4^000 or more in 
both 1973 and 1974. 

Variables used in the mate* were identical for all three 
groups, but the priority givenJto them differed. These variables 
wer^e sex, race/ethnicity, age,\ducation, family income, labor 
force experience, head of family, SSA earnings 1975, SSA earnings 
change 1974.-75, SSA earnings change 1973-74, poverty status, and 
class' of worker. Exact matches were achieved in all three subsets 
for sex and race/ethnicity. For low earners, match priority was 
given to demographic variables such as age and education, since 
their preprogram earnings were found not to be as important in 
predicting postprogram earnings. For intermediate/mixed and high- 
er earner groups, demographic characteristics were subordinate to 
the preprogram earnings variables. 

The numbers of cases available for analysis after matching 

were 

« 

CETA CPS 

Low 3,134. 2,432 

Intermediate/mixed 2,212 1,601 

Higher 940 1,216 

Total 6,286 5,249 

Individual CPS cases were given a weight corresponding to 
the ratio pf CLMS to CPS cases within each match cell. 

The adequacy of the match was evaluated as far as possible 
on the basis of three criteria: similarity of (1) CETA and CPS 
comparison groups on socioeconomic characteristics koown to be 
determinants of earnings, (2) preprogram earnings, and (3) earn- 
ings models as applied to preprogram earnings. 

This matching procedure yielded closely controlled compari- 
sons 'of results overall and by preprogram earnings histories, 
Sex, and race/ethnicity, but this is not necessarily true for 
the comparisons of service types — classroom training, on-the-job 
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training^ work experience, and public service employment. Match 
lists were not constructed separately for service types. 



ANALYSIS 



/ 



The analysis proceeded v 

from a model in which SSA earnings in a postprogram 
year (1977) are assumed to be a linear function of 
earnings in a preprogram year or years, demographic 
and socioeconomic characteristics , extent of labor 
force participation in the prior year, other personal 
characteristics, such as veteran status, and partici- 
pation in CETA. (\$7estat, 1981a, pp. 3-17 and 3-18) 

,) 

Participation in CETA was analyzed in terms of such factors as 
service type, length of stay, and placement at termination. 
Separate sets of models were constructed for each subgroup of 
preprogram earnings history by race/ethnicity by sex, yielding 
twelve basic sets. 

POTENTIAL BIASES 

Although Westat's twofold approach to adjusting for nonequiv- 
alences between the CETA participant sample and the CPS comparison 
group appears to be consistent with common practice and conserva- 
tive, a number of potential biases should be kept in mind when we 
interpret the^ results. Westat has summarized them in the net 
impact report;^ four of the mo^t important are listed here. 

1. Th^ procedures used to correct for nonequivalences 
between tjroups can correct only for the part of the nonequivalence 
that is related to measured characteristics. There may be differ- 
ences in unmeasured characteristics (orvcharacteri sties measured 
with substantial error) that are not adequately ad justed > t or . 

2. Some people in the CPS comparison gropp-may have par- 
ticipated in CETA, confounding the comparison between participants 
and nonparticipants . This contamination is thought to be more a 
problem for minorities and youth than for other demographic sub- 
groups. ■ - "* 

3. . Because not all jobs are part of the 'Social Security 
system and'because CETA participants are ma>re likely to be in 
public sector -jobs not covered by Social Security than CPS com-: 
parison g^oup members, there is a downward bias in the net impact 
estimates. ■ It is estimated to be around $100 overall arid $100 
to $500 for PSE. Adjustments have not been computed for work 
experience. 

4. The lack of separate matching procedures for participants 
in CETA service typep means that these estimates are more vulner- 
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able to selection biases than estimates for preprogram earnings or 
race/ethnicity subgroups. *This is especially ^problem for work 
experience because participants in this service were generality 
less employable, creating the risk of a downward bias. 




A 



i 



126 



ERIC 



APPENDIX II APPENDIX II 



REFERENCES 

BAILY, M . N. , and J. Tobin. "Inflation-Unemployment Consequences 
of Job Creation Policies," Creating Jobs: Public Employment 
Programs and Wage Subsidies , ed. J. Palmer, pp. 43-85. Washing- 
ton, D.C.: The Brookings Institution, 1978. 



. "Macroeconomic Effects of Selective Public Employment and 

Wage Subsidies . ". v Brookings Papers on Economic Activity , Vol . 1 
(1977), pp. 511-41. 

BASSI, L • , and A. s Fechter. The Implications for Fiscal Substitu - 
tion and Occupational Displacement Under an Expanded CETA Title 
VI . Washington, D.C. : U.S. Department of Labor, Office of 
the Assistant Secretary for Policy, Evaluation, and Research, 
Technical Analysis Paper 65, March 1979. 

BLINDER, A. S.,. and R. M. Solow. "Analytical Foundations of Fis- 
.cal Policy." The Economics of Public Finance , ed. A. S. Blinder 
et al. Washington, D.C: The Brookings Institution, 1974. 

BORUS, M. E. Measuring the Impact of Employment-Related Social 
Programs; A Primer on the Evaluation of Employment and Train - 
ing, Vocational Education, Vocational Rehabilitation, and Other 
Job-Oriented Programs" ! Kalamazoo, Mich. : The W. E. Upjohn 
Institute for Employment Research, 1979. 

"Indicators of CETA Performance." Industrial and Labor 



Relations Review , Vol. 32 (1978), pp. 3-14. 

.BORUS, M. E., and D. Hamp^mesh . "Study of the Net Employment 
Effects of Public Service Employment: Econometric Analyses," 
An Interim Report to the Congress of the National Commission 
for Manpower Policy: Job Creation Through Public Service 
Employment *, Vol. 3, Commissioned Papers , pp. 89-149. Wash- 
ington, D.C: . National Commission for Manpower Policy, 1978. 

Comprehensive Employment and Training Act of 1973. 29 U.S.C'. 
801. 

Comprehensive Employment and Training Act Amendments of 1978. 



29 U.S/C. 801. 



r 



,--C$)0K, T. D., and D. T. Campbell. "The Design and Conduct of 
Quasi-Experiments and True Experiments in Field Settings," 
Handbook of Industrial and Organizational Psychology , ed. 
M. D. Dunnette, pp. 223-326. Chicago: Rand McNally, 1976 . 

COOLEY, T. F., T. W. McGuire, and ET. G. Prescott. The Impact of 
Manpower Training on Earnings: An Econometric Analysis .Wash- 
ington, D.C. : U.S. Department of Labor, Employment and Train- 
ing Administration, Office of Program Evaluation, September 30, 

, 1975. • 



127 iTy 



APPENDIX II 



APPENDIX II 



DIRECTOR, S. M. "Underad justment Bias in the Evaluation of Man- 
power Training." Evaluation Quarterly , Vol. 3 (1979), pp. 
190-218. " 



Economic Report of the President . Washington , D.C. : U.S. 
Government Printing Office, 1981. 

EMPLOYMENT AND TRAINING ADMINISTRATION . CETA 'Program Status 
and Financial Summary — Fiscal Year 1980 . Washington, D.C. : 
U.S. Department of Labor, 1980a . 

Forms Preparation Handbook . Washington, D.C: U.S. 
Department of Labor, April 1980b. 

Summary of Participant Characteristics — Fiscal Year 
1980 . Washington, D.C. : U.S. Department of Labor, 1980c. 

• Work Experience Perspectives; CETA. Program Models . 

Wa sh i ngton, D.C. : U.S. Department of Labor, 1979. 

• Classroom Training — The QIC Approach; CETA Program 

Models . Washington, D.C: U.S. Department of Labor, 1978a.. 

On-the-Job Training; CETA Program Models . Washington, 
D.C. : U.S. Department of Labor., 1978b. 

• Public Service Employment; CETA Program Models . Wash- 
ington") D.C. : U.S. Department of Labor, 1978c. 

Employment and Training Report of the President . Washington, 
D.C: U.S. Department of Labor, 1980. 

FINIFTER, D. H. An Analysis of Two-Year Post-Program Earnings 
Paths of CETA Participants Using the Early CLMS Cohorts (Janu - 
ary 1975-June 1975 EntryT i Washington, D.C. : U.S. Department 
of Labor, Employment and Training Administration, Office of 
Program Evaluation, December 1980. 

FRIEDMAN, M. "A Monetary Theory of Nominal Income." Journal 
of Political Economy , Vol . 79 (1971) , pp. 323-37. 

GARFINKEL, I., and J. L. Palmer. "Issues, Evidence, and Impli- 
cations," Creating Jobs; Public Employment Programs and Wage 
Subsidies , ed. J. L. Palmer, pp. 1-42 . Washington, D.C : The 
Brookings Institution, 1978. . 

GAY, R. S., and M. E. Borus . "Validating Performance Indicators 
for Employment and Training Programs." Journal of t*uman Re- 
sources , vol. 15 (1980), pp. 29-48. * 

I 

GERACI, V. J., and C. T. King. "Efrnployment and Training (CETA) 
Program Performance: Long-Ternr > Earnings Effects and Short-Term 
Indicators. Paper Presented at The Allied Social Science 
Association Meetings, Denver, Colorado, September 1980 



ERIC . 128 



*i o v j 



APPENDIX II 



APPENDIX II 



GINZBERG, E. "Overview: 3Jhe $64 Billion Innovation," Employing 
the Unemployed , ed. E» Ginzbeng, pp. 1-24. New %ork: Basic 
Books, 1980. 

, ed. Jobs for Americans . Englewood* Cliff s , N.J.: Prentice 

Hall, 1976. 

GRAMLICH, E. "Stimulating the Macro Economy Through State and *v 
Local Governments." American Economic Review , Vol. 69 (1979), 
pp. 180-85. 

JERRETT, R., and T. A. Barocci. Public Works, Government Spend - 
ing, and Job Creation . New York: Praeger, 1979. 

JOHNSON, G./and J. D. Tomola. "The Fiscal Substitution Effect 
k of Alternative Approaches to Public Service Employment Policy." 
Journal of Huma-n Resources , Vol. 12 (1977), pp. 3-26. 

KEMPER, P., and P. Moss. "Economic Efficiency of Public Employ- 
ment Programs, " Creating Jobs: Public Employment Programs and 
Wage Subsidies, ed. J. L. Palmer, pp. 277-322. Washington, D.C. 
The Broowings Institution, 1978 . 

KESSELMAN, Jv "Work Relief Programs in the Great Depression, " 
Creating Jobs; Public Employment Programs and Wage Subsidies , 
ed. J. L • Palmer, pp. 153-229. Washington, D.C: The Brook- 
ings Institution, 1978 . 

KILLINGS WORTH , C "The Role of Public Service Employment," 

Industrial Relations Research Association: Proceedings of the 
197 7 Annual Spring Meeting , eds . J'. L. S^ern and B. D. Dennis, 
pp. 489-95. Chicago: Commerce Clearing House, 1977. 

LEVI TAN, S. A., and R. S. Belous. "Bridges to. the Private Sector: 
Remedial Employment and Training Programs." Paper Prepared for 
the National Council on Employment Policy Conference on CETA 
Reauthorization , Washington , D.C, June 25, 1981 ♦ 

Making the Connections: Private IndustVy Councils, A New Direc - 
tion for CETA, Year 2 Report . Philadelphia: The Corporation 
for Public/Private Ventures, February 1980. 

MANGUM, G. / and R. Taggart. CETA Service Components: Results 
and Reasons . Washington, D.C: National Council on Employment 
Policy, June 1981. 

MATHEMATICA POLICY RESEARCH, INC Evaluation of the Economic 
Impact Of the Job Corps Program . Washington, D.C . : U.S. 
Department of Labor, Employment and Training Administration, 
April 1980. 

MIRENGOFF, W. , et al. ' The New CETA: feffect on Public Service 
Employment Programs: Final Report . Washington, D.C : Na- 
tional Academy of Sciences, 1980. 



129 

1 t 



APPENDIX II 



APPENDIX II 



MIRENGOFF, W., and L. Rindler. The Comprehensive Employment and 
Training Act: Impact on People Places Programs — An Interim 
Report / Washington, D.C: National Academy of Sciences, 
1976. 

MITCHELL, J. J>. , M. L. Chadwin, and D. S. Nightingale. Implement - 
ing Welfare-Employment Programs; An Institutional Analysis of 
the Work Incentive (WIN) Program , R&D Monograph 78, prepared bv 
The Urban Institute- Washington, D.C: U.S. Department of 
Labor, Employment and Training Administration, 1980. 

NATHAN, R. p., et al. Public Service Employment; A Field Eval - 
uation . Washington, D.C. : The Brookings Institution, 1981. 



• Job Creation Through Public Service Employment , Vol. 2, 

Monitoring the Public Service Employment Program , prepared by 
The Brookings Institution. Washington, D.C. : National Commis- 
sion for Manpower Policy, March 197 8. 

. 

NATIONAL PLANNING ASSN. . An Evaluation of the Economic Impact , 
project of the Public Employment Program , Vol. 1. Washington, 
D.C: U.S. Department of Labor, Office of the Assistant Secre- 
tary for Policy, Evaluation, and Research, 1974. 

OHIO STATE UNIVERSITY. A Formative Evaluation of the Private 
Sector Initiative Program, Report No. 6 , prepared bv Mershon 
Center CETA Study. Washington, D.C: U.S. Department of Labor, 
Employment and Training Administration, Office of Program Eval- 
uation, June 1981a. 

• A Formative Evaluation of the Private Sector Initiative 

Program, Report No. 5 , prepared by Mershon Center CETA Study. 
Washington, D.C: U.S. Department of Labor, Employment 
and Training Administration, Office of Program Evaluation, 
January 1981b . 

• A Formative Evaluation of the Private Sector initiative 

Program, Report No. 4 , prepared by Mershon Icenter CETA\Study. 
Washington, D.C: U^S. Department of Labor\ Employment\and 
Training Administration, Office of Program Evaluation, AQgust 
1980a. 



A Formative Evaluation of the Private/Sector Initiative 
Program, Report No. 3 , prepared by Mershon Center CETA Study. 
Washington, D.C: U.S. Department of Labor, Employment and 
Training Administration , Office of Program Evaluation, January 
1980b^ 

• A Formative Evaluation of the Privat\ Sector Initiative 

Program, Report No. 2 , prepared by Mershon Center CETA Study. 
Washington, D.C: U.S. Department of Labor, Employment and 
Training Administration, Office of Program Evaluation, October 
1979a. 



\ 



130 



1 ~ - 

*^ \J 



r 

APPENDIX II APPENDIX II 

A Formative Evaluation of the Private Sector Initiative 
Program, Report No* 1 / prepared by Mershon Center CETA Study . 
Washington, D.C. : UTS. Department of Labor, Employment and 
Training Administration, Office of Program Evaluation, May 1979b. 

OKUN, A. M. "Conflicting National Goals, 1 ' Jobs for Americans , 
ed. E. Ginzberg, pp. 59-84. / Englewood Cliffs, N.J.: Prentice- 
Hall, 1976. f \^ 

PERRY, C. R., et al . The Impact of Government Manpower Programs 
in General and on Minorities and Women" ! Philadelphia: Univer- 
sity of Pennsylvania, 1975. 

Private Sector Initiatives Program; CETA Title VII Implementa - 
tion in Seventeen Study Sites--Third Year Interim Report . Phil- 
adelphia! The Corporation f oi/Til^lic/Pri vate Ventures, May 1981. 

SCHILLER, B. R. "Welfare: Reforming Our Expectations." The 
Public Interest , Vol. 62 (1981), pp. 55-65. 

Sixth Annual Report to the President and the Congress . Washing- 
ton, D.C: National Commission for Employment Policy, December 
1980. 

SOLOW, R. M. "Employment Policy in Inflationary Times," Em - 
ploying the Unemployed , ed. E. Ginzberg, pp. 129-141. New 
York: Basic Books, 1980. 

TAGGART , R . A Fisherman's Guide: An Assessment of Training and 
Remediation Strategies" ! Kalamazoo, Mich. : The E. Upjohn 
Institute for Employment Research, 1981. 

Temporary Measures to Stimulate Employment: An Evaluation of 
Some Alternatives . Washington, D.C. : Congressional Budget 
Office , September 1975. 

V ( 

The Impact of Employment and Training Programs . Washington , 
D.C. % National Council on Employment Policy, November 19 76. 

TOBIN, J. "Stabilization Policy Ten Years After." Brookings 
Papers on Economic Activity , Vol. 1 (1980), pp. 19-71. 

ULMAN, L. "Manpower Policies and Demand Management." Jobs for 
Americans , ed. E. Ginzberg, pp . 85-119. Englewood Cliff's, " 
N.J. : Prentice-Hall, 1976. 

UNITED STATES, General Accounting Office. Labor Should Make 
Sure CETA Programs Have Effective Employability Development 
Systems , HRD-82-2 . Washington , D.C..: January 13 , 1982 . 

Moving Participants from Public Service Employment Pro - 
grams into Unsubsidized Jobs Needs More Attention , HRD-79-101 
Washington, D.C: October 12, 1979. 



i3i 153 



1 




APPENDIX II 



APPENDIX II 



WESTAT, INC. Continuous Longitudinal Manpower Survey, Net Impact 
Report No. 1: Impact on 1977 Earnings of New FY 1976 Enrollees 
in Selected Program Activities . Washington, D.C. : U.S. Depart- 
ment of Labor, Employment and Training Administration, Office 
of Program Evaluation, March 1981a. 



Continuous Longitudinal Manpower Survey, Follow-Up Report 
No. 3 (36 Months After Entry) Experiences in the First Two 
Postprogram Years, with Pre/Post Comparisons, for Terminees 
Who Entered CETA During January-June 1975 , Vol. 1, Descriptive 
Report. Washington, D.C: U.S. Department of Labor, Employment 
and Training Administration, Office of Program Evaluation, 
January 1981b. 



Continuous Longitudinal Manpower Survey, Fol low-Up * Report 
No. 3 736 Months After Entry) Experiences in the First Two 
Postprogram Years, With 'Pre/ Post Comparisons, for Terminees Who 
Entered CETA During January-June 1975 , Vol. 2, Appendices and 
Tables. Washington, D.C.:* U.S. Department of Labor, Employment 
and Training Administration, Office of Program Evaluation, 
January 1981c. J 



Continuous Longitudinal Manpower Survey, Report No. 10, 
Characteristics of Enrollees Who Entered Adult-Oriented CETA 
Programs During Fiscal Year 1978 ^(October 1977 Through September 
1978) » Washington, D.C: U.S. Department of Labor, Employment 
and Training Administration, Office of Program Evaluation, 
January 1980. 



Continuous Longitudinal Manpower Survey, Follow-Up Report 
No. 2 (18 Months After Entry) Postprogram Experiences and Pre/ 
Post Comparisons for Terminees Who Entered CETA During -Fiscal 
Year 1976 (July 1975-June 19"76T : Washington, D.C: uTs^ 
Department of Labor, Employment and Training Adminis tra£ipn , 
Office of Program Evaluation, March 1979a. , / J 



Continuous Longitudinal Manpower Survey, Report No. 8, 
Characteristics of Enrollees Who Entered CETA Programs^uring 
Fiscal Year 1977 (October 1976 Through September 1977) . Wash- 
ington, D.C.: * U.S. Department of Labor, Employment and Training 
Administration, Office of Program Evaluation, March 1979b. 



Continuous Longitudinal Manpower Survey, Report No. 6 , 
Characteristics of New Enrollees in CETA Programs During Fiscal 
Year 1976 (October 1976 Through September 1977) . Washington, 
D.C. : ^ U.S. Department of Labor, Employment and Training 
Administration, Office of Program Evaluation, August 1977*. 

WILLIAMS, W. Government by Agency: Lessons from the Social 
Program Grants-in-Aid Experienc ed New York: Academic Press, 
1980 . s 

WISEMAN, M. "Public Employment" as Fiscal Policy." Brookings 
* Papers on Economic Activity , VolNJL (1976), pp. 6,7-104. 



132 



APPENDIX III 



APPENDIX III 



MAJORITY MCMtCftS: 

AUGUSTUS r. HAWKINS. CAW- CMAJftUAM 

WtLUAM fall.) CLAY, MO. 

TC» WOlt, H.V. 

•AlTAtA* COAAAtA, P «, 

WHUJAM A\ MATCMPOAO. COWC 

rAUt. S4MOM. to. 

AAPHAC1. MUtTO. PA. 

CAM. O. PCRIUM*. KY_ KX OfHCW 

(202) 225-1*27 



CONGRESS OF tME UNITED STATES 
HOUSE OF REPRESENTATIVES 

COMMITTEE ON EDUCATION AND LABOR 
SUBCOMMITTEE ON EMPLOYMENT OPPORTUNITIES 

B-346A RAY BURN HOUSE OFFICE BUILDING 
1 WASHINGTON, D.C. 20515 



MINORITY MEMBERS. 
MMCS M jtrrc*o*. VT. 

THOMAS XAIIAC lOwvA 

imOmaS C reim wis. 

^OMN M. ASMSHOOK, OHIO. CX OFFICIO 
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Mr. Milton Til. Sooolar 

Acting Comptroller General f 

of the United States 
General Accounting Office 
Room 7026 

441 "G" Street, N.W. 
Washington, D.C. 20548 

Dear Mr. Socolar: 

The Subcoirmittee on Employment Opportunities anticipates conducting 
oversight on the Comprehensive Employment and Training Act ^during the middle 
to late surmer of 1981. Information on the effectiveness of various types^ 
of CETA services would be particularly valuable to the Subcommittee during 
its deliberations. Initial discussions between my staff Director, Susan 
Grayson and staff from your Institute for Program Evaluation indicated 
that this is feasible. ^ 

The Subconmittee is interested in obtaining an assessment of existing 
evaluation information for at least four types of CETA Services - classroom 
training, on-the-job training, work experience, and public service employ- 
ment. It would be most helpful if this work were based on a technical review 
of evaluation designs and products such that it presents and integrates the 
results of the soundest and most comprehens&e CETA evaluations. 

It would be most helpful if Institute staff members could brief my 
staff or me sometime in August with a written report following scon thereafter. 




Augustus F. Hawkins 
Chairman 
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U.S. Department of Labor 



Assistant Secretary for 
Employment and Training 
Washington D C 202 10 




\ 



MAY 20 1982 



Mr. Gregory J. Ahart A 

Director 4 

Human Resources Division 

0. S, General Accounting Office 

Washington, D. C. 20548 

Dear Mr. Anart: 

This is in reply to your letter to Secretary Donovan request! 
comments on the draft QAO report entitled, "CETA Programs for 
Disadvantaged Adults - What Do We Know Afcfout Their Snrollees, 
Services and Etfectiveness?" The Departments response is 
enclosed . 

The Department appreciates the opportunity to comment on this 
report. 

Sincerely, 
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Department of Lalaor's Response to Draft GAO Report 
Entitled "CETA Programs for Disadvantaged Adults - 
What Do We Know About Their Enrollees, Services 
and Effectiveness?" 



GAO note a 



GAO note b 



The draft GAO report, "CETA Programs for Disadvantaged 
Adults - What Do We Know About Enrollees, Services and 
Effectiveness?", assesses the performance of adult-oriented 
CETA programs with- regard to enrollees, services and effec- 
tiveness by reviewing existing information sources, such as 
program administrative data fnd the results of evaluation and 
research studies. The report synthesizes a diverse set of 
data and analyses in an effort to provide a broad overview 
of CETA's program for adults. Although' the text stresses 
the need for caution in interpreting these results, we are 
concerned that the absences of the*se caeveats in the digest 
may lead some to draw hasty conclusions re CETA's services 
and their impacts. 

/ While the need for selectivity in a review of this 

nature is recognized, the Department would like to make 
special note of the GAO reviewers failure to use program cost 
data.* While such data may be limited when analyzing evaluation 
studies, data are available, by title, through the CETA 
reporting system. The Department believes that any compre- 
hensive analysis of the effectiveness of CETA programs must 

Vnecessarily include such data. 

In a report of the scope and complexity of this, there 
is much on which we could comment. Since the GAO has not 
drawn final conclusions and is not making recommendations, 
however, the Department does not see the need to comment on 
specific points made in the literature review. 



GAO notes: 

a/GAO believes that the caveats in the Digest are appropriate 
and sufficient to enable readers to draw reasonable conclu- 
sions regarding the performance of CETA adult services. 

b/The draft report that the Department of Labor reviewed did 
include a summary of program cost data (outlays) for CETA 
titles IIB, IID, and VI for fiscal years 1975-80, in table 1, 
which JjS on page 10. 
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